Web Survey Bibliography
Traditionally, business data for official statistics have been collected with paper questionnaires in self administrative surveys. Nowadays the paper questionnaire is more and more replaced by web questionnaires. A variety of strategies can be followed to introduce the web in business surveys. In Norway in 2004, and recently in Denmark, it has been decided that all business surveys should be transformed to the web quickly. In the Netherlands an effort has been made to develop a well-designed web questionnaire: the Structural Business Survey questionnaire was fully designed and pre-tested in a two-year period. The result was supposed to serve as an example for all other surveys. A driving force behind this development is a common interest by the surveyors and those who are surveyed to reduce the manpower, and hence the costs of business surveys (including response burden).
But neither these ambitions nor quality improvements come automatically with technological innovations. At international conferences, workshops and meetings, we find that many methodologists are struggling with the implementation of these technologies. In February 2010, methodologist from 8 European countries met in Copenhagen to discuss how common EU-regulated surveys best can be transferred from paper to web (both for business and social surveys; the focus was on business surveys). The idea for this meeting was born when data collection methodologists from Statistics Denmark visited Statistics Netherlands in May 2009 to discuss web questionnaire designs. The initiative to organise this meeting was taken at the 2009 ISM Workshop in Bergamo. In follow-up to the Copenhagen meeting, this topic was also at the agenda of the Eurostat Working Group of Statistical Quality in June 2010. Here it was decided to discuss the need for an action plan and concrete projects with the Directors of Methodology.
This 2011 ISM presentation is a follow-up of the Copenhagen initiative, and is meant to report back to the participants what has been done. In the presentation we will give an overview of the issues that have been discussed, and relate those to non-sampling errors like non-response and measurement issues, as well as response burden. We would like to discuss with the audience how the Copenhagen initiative and the issues raised best could be followed up.
Issues that have been discussed (and which have relations to other presentations in the Workshop) are:
– An issue that is discussed over and over again is how to get sampled units pick-up the web questionnaire: What strategies should be used to increase the take-up rate? Should a paper questionnaire still be available, and presented?
– Where are we when it comes to guidelines in how to design web questionnaires? One much discussed issue under this headline is how similar or different web and paper questionnaires in a mixed mode data collection design should be. When respondents use a web questionnaire, they expect it to have some intelligence. What do respondents expect and what guidelines can be given to make the questionnaire respondent friendly? Issues here are e.g. the use of matrix questions and edit checks that help to get good data quality but may also result in aborting the completion of the questionnaire. Another issue is the use of historic data in the questionnaire (comparable to dependent interviewing).
– Talking about mixed-mode designs: How to deal with mode effects?
– Technology issues include e.g. how to deal with the variety of software browsers?
– How to implement web questionnaires? When moving to the web, Statistics Netherlands on the one side, and Statistics Norway and Statistics Denmark on the other, adopted different approaches (as discussed above). What did we learn from these two approaches?
– Once a questionnaire has been developed, the issue is: How do new methods affect pre-tests and the ability to monitor the response process?
During the development of web questionnaires traditional cognitive interviewing and the techniques of usability studies can be combined, e.g. by using paradata and eye-tracking during individual tests. Computerized questionnaires also opens the possibility to monitor the response process in a detailed way while conducting the survey (using paradata), both at the level of overall response rates as well at the level of individual respondents (using audit trails).
In our presentation we will focus in some more detail on web pick-up issues and response burden issues.
Issues that have not yet been addressed, but which are important and can be discussed at the workshop, are:
– How to organising the data collection and logistics for web and mixed-mode surveys?
– What software should be used: develop ones own software or use software that is available in the market?
– How to organise research, collaborate with universities, and bring in the literature?
Workshop Homepage (abstract) / (presentation)
Web survey bibliography - Denmark (31)
- Representative web-survey!; 2016; Linde, P.
- Correcting for non-response bias in contingent valuation surveys concerning environmental non-market...; 2015; Bonnichsen, O.; Boye Olsen, S.
- The effect of multiple reminders on response patterns in a Danish health survey; 2015; Christensen, A. I.; Ekholm, O.; Kristensen, P. L.; Larsen, F. B.; Vinding, A. L.; Gluemer, C.; Juel,...
- Disclosure of sensitive behaviors across self-administered survey modes: a meta-analysis; 2014; Gnambs, T., Kaspar, K.
- Self-reported cheating in web surveys on political knowledge; 2014; Jensen, C., Thomsen, J. P. F.
- Improving Survey Response Rates in Online Panels Effects of Low-Cost Incentives and Cost-Free Text Appeal...; 2014; Pedersen, M. J., Nielsen, C. V.
- Online Qualitative Research – Personality Matters ; 2014; Tress, F., Doessel, C.
- Is it what you say, or how you say It? An experimental analysis of the effects of invitation wording...; 2014; Fazekas, Z., Wall, M. T., Krouwel, A.
- Measuring Mobile Phone Use: Self-Report Versus Log Data; 2013; Boase, J., Ling, R.
- Effect of survey mode on response patterns: comparison of face-to-face and self-administered modes in...; 2013; Illemann Christensen, A., Ekholm, O., Gluemer, C., Juel, K.
- ESSnet Data: Collection for Social Surveys using Multiple Modes; 2013; Sattelberger, S., Blanke, K.
- A Framework for the Collection of Universal Client Side Paradata (UCSP); 2012; Kaczmirek, L.
- Does survey experience affect respondents’ reported level of satisfaction?; 2012; Schultz Christensen, A., Ladenburg, J.
- Efficiency of Different Recruitment Strategies for Web Panels; 2012; Hansen, K. M., Pedersen, R. T.
- “Don’t know” the difference - An experimental comparison between Web and CATI; 2011; Schielicke, A.-M., Degen, M.
- On Affordances and Technological Intersubjectivity; 2011; Vatrapu, R.
- Usability and burden measurement in online forms; 2011; Thomsen, P.
- Dynamic Data Editing in online data collection for the Vacant Positions Survey; 2011; Stax, H.-P.
- Utilizing Web Technology in Business Data Collection: Some Norwegian, Dutch and Danish Experiences; 2011; Snijkers, G., Haraldsen, G., Stax, H.-P.
- Does the Inclusion of a Cost Attribute in Forced and Unforced Choices Matter? Results from a Web Survey...; 2011; Pedersen, L. B., Kjaer, T., Kragstrup, J., Gyrd-Hansen, D.
- Utilizing Web Technology in Business Data Collection: Some Norwegian, Dutch and Danish Experiences; 2011; Haraldsen, G., Snijkers, G., Roos, M., Sundvoll, A., Vik, T., Stax, H.-P.
- Examination of a ’Web Mode Effect’. An Experimental Comparison of Web and Paper Based Surveys...; 2011; Shamshiri-Petersen, D., Clement, S. L.
- The impact of incentives and interview methods on response quantity and quality in diary- and booklet...; 2010; Bonke, J., Fallesen, P.
- Measuring Internet And Press Audience In The Media Convergence Era. In Search Of A New Paradigm In Researching...; 2009; Pawlak, J., Póltorak, M.
- Choosing Between Internet and Mail Survey Modes for Choice Experiment Surveys Considering Non-Market...; 2009; Boye Olsen, S.
- Using mobile phones to measure TV-broadcast quality; 2009; Wieland, J. L., Puggaard, B.
- Differential response rates in postal and Web-based surveys in older respondents; 2009; Bech, M., Kristensen, M. B.
- Response rate and completeness of questionnaires: A randomized study of internet versus Paper-and-Pencil...; 2007; Holm- Christensen, K., Hjollund, H. N., Basnov, M., Kongsved, S. M.
- The impact of material incentives on response quantity, response quality, sample composition, survey...; 2004; Goeritz, A.
- Willingness to Pay for Organic Foods: A Comparison between Survey Data and Panel Data from Denmark ; 2002; Millock, K.; Hansen, L.G.; Wier, M.; Andersen, L.M
- Online Research: Methoden, Anwendungen und Ergebnisse ; 1999; Batinic, B., Bandilla, W., Graef, L., Werner, A.