Web Survey Bibliography
In 2010, Statistics Canada launched a five-year project to introduce electronic questionnaire (e-questionnaire (EQ) or web questionnaire) as a primary collection mode for over 160 business and household surveys. While business surveys have been using EQ for the last few years, household surveys have faced a different set of implementation issues. For example, cross-sectional household surveys first collect basic household information and then administer subject-matter content to a randomly selected household member. This methodology leads to appr. 40% of cases having two respondents within a household – to complete the roster and household information, and to complete the subject-matter portion of a survey.
Relevance and Research question
What are the options for sequential multi-mode collection strategies with the use of EQ for cross-sectional household surveys? This is very important for Statistics Canada to formulate a new collection strategy to deliver expected Internet take up rates and targeted collection costs savings. The balance has to be reached between methodological requirements, technological feasibility, respondent burden, and expected costs savings.
Methods and Data
A working group was formed to identify possible multi-mode collection strategies and proposed four possible strategies. There was no clear evidence to favor a specific strategy. As a result, the group proposed to test options to assess Internet take-up rates when using CAI for initial contact / roster or when an invitation letter is mailed to a household, respondent reaction and willingness to invite other household members to continue EQ completion, operational complexity etc.
Results
The first strategy, doing a roster via CAI and using EQ for subject-matter content, was tested with the General Social Survey in 2012. 10,006 units were sampled using RDD frame, and 5,654 were reached via CATI (66%). Out of these respondents, 3,487 accepted to do EQ (62%) and 1,349 respondents submitted a completed EQ (24% of CATI respondents). Only e-mail reminders were used to stimulate response. These results surpassed the 20% EQ response target and showed potential for this option. The other options are planned to be tested in 2013-2014.
Added Value
Develop a multi-mode collection strategy that will allow Statistics Canada achieve its strategic objectives.
GOR Homepage (abstract) / (presentation)
Web survey bibliography - General Online Research Conference (GOR) 2013 (34)
- Respondent Rewards: Money for Nothing?; 2013; Martin, P.
- Pros and cons of virtual interviewers – vote in the discussion about surveytainment; 2013; Póltorak, M., Kowalski, J.
- The fish model: What factors affect participants while filling in an online questionnaire?; 2013; Mohamed, B., Lorenz, A., Pscheida, D.
- Interview Duration in Web Surveys: Integrating Different Levels of Explanation; 2013; Rossmann, J., Gummer, T.
- The monetary value of good questionnaire design; 2013; Tress, F.
- Technical and methodological meta-information on current practices in online research: A full population...; 2013; Burger, C., Stieger, S.
- Using interactive feedback to enhance response quality in Web surveys. The case of open-ended questions...; 2013; Emde, M., Fuchs, M.
- Reducing Response Order Effects in Check-All-That-Apply Questions by Use of Dynamic Tooltip Instructions...; 2013; Kunz, T., Fuchs, M.
- Measuring wages via a volunteer web survey – a cross-national analysis of item nonresponse; 2013; Steinmetz, S., Annmaria, B.
- Does one really know?: Avoiding noninformative answers in a reliable way.; 2013; de Leeuw, E. D., Boevee, A., Hox, J.
- Sensitive Topics in PC and Mobile Web Surveys; 2013; Mavletova, A. M., Couper, M. P.
- Mobile Research Performance: How Mobile Respondents Differ from PC Users Concerning Interview Quality...; 2013; Schmidt, S., Wenzel, O.
- Who responds to website visitor satisfaction surveys?; 2013; Andreadis, I.
- Measuring working conditions in a volunteer web survey; 2013; de Pedraza, P., Villacampa, A.
- Sampling online communities: using triplets as basis for a (semi-) automated hyperlink web crawler.; 2013; Veny, Y.
- Why are you leaving me?? - Personality predictors of answering drop out in an online-study; 2013; Thielsch, M., Nestler, S., Back, M.
- Propensity Score Weighting – Can Personality Adjust for Selectivity?; 2013; Glantz, A., Greszki, R.
- Research Design as an Influencing Factor for Reliability in Online Market Research; 2013; Wengrzik, J., Theuner, G.
- Ethics, privacy and data security in web-based course evaluation; 2013; Salaschek, M., Meese, C., Thielsch, M.
- Seducing the respondent – how to optimise invitations in on-site online research?; 2013; Póltorak, M., Kowalski, J.
- Influence of mobile devices in online surveys; 2013; Maxl, E., Baumgartner, T.
- E-questionnaire in cross-sectional household surveys; 2013; Karaganis, M.
- GESIS Online Panel Pilot: Results from a Probability-Based Online Access Panel; 2013; Kaczmirek, L., Bandilla, W., Schaurer, I., Struminskaya, B., Weyandt, K.
- Online Survey – Research with children on advertising impact; 2013; Funkenweh, V., Busch, J., Amthor, A. L., Boeer, A., Gaedke, J.
- HTML5 and mobile Web surveys: A Web experiment on new input types; 2013; Funke, F.
- Metadata on the demographics of online research: Results from a full-range study of available online...; 2013; Burger, C., Stieger, S.
- How the screen-out influence the dropout of a commercial panel; 2013; Bartoli, B.
- Beyond methodology - some ethical implications of "doing research online"; 2013; Heise, N.
- Innovation in Data Collection: the Responsive Design Approach; 2013; Bianchi, A., Biffignandi, S.
- Break-off and attrition in the GIP amongst technologically experienced and inexperienced participants...; 2013; Blom, A. G., Bossert, D., Clark, V., Funke, F., Gebhard, F., Holthausen, A., Krieger, U., Wachenfeld...
- Nonresponse and Nonresponse Bias in a Probability-Based Internet Panel; 2013; Blom, A. G., Bossert, D., Funke, F., Gebhard, F., Holthausen, A., Krieger, U.
- Rewards - Money for Nothing?; 2013; Cape, P. J., Martin, P.
- Effects of incentive reduction after a series of higher incentive waves in a probability-based online...; 2013; Struminskaya, B., Kaczmirek, L., Schaurer, I., Bandilla, W.
- Timing of Nonparticipation in an Online Panel: The effect of incentive strategies; 2013; Douhou, S., Scherpenzeel, A.