Web Survey Bibliography
In contemporary social sciences the survey research processes – from conceptualization and empirical implementation to analysis and dissemination – are increasingly supported with information-communication technologies. However, only parts of this process have fully shifted online so far. In practice, this is true for questionnaire design, distribution and data collection, while earlier stages (questionnaire development and testing) are not fully integrated yet. Similarly, the research literature mostly focuses on questionnaire design and data entry phase with considerable research also on distribution, publication, solicitation and collection. On the other hand, there is almost no literature regarding the role of the web in construction, pretesting and piloting of the instrument. In practice, this step is thus predominantly conducted offline (using word processors), while limited support for online commenting is sometimes included at a rather late stage of questionnaire development.
In this paper, the issues of full web integration of the survey process are discussed. First, a brief overview is presented about past research of the authors in the area of web software. Next, requirements for web survey software are identified according to the needs for effective support in questionnaire construction and testing stage (e.g. inline editing, extensive drag and drop, structuring, commenting, copying, versioning, archiving …).
Finally, results of an experiment are presented, where four groups of users were developing questionnaires in alternative ways:
1. Fully online supported development process (no emailing, no word processors), using a specific web survey software, which was as a pilot developed for this task;
2. Standard approach, where questionnaire is first drafted within some word processor (e.g. MS Word) and then exchanged, discussed and versioned via usual channels (e.g. e-mail, web sites, on-line platforms, forums) or via some external tools (e.g. SharePoint, DropBox, GoogleDoc).
The results show that the questionnaire development process, which is fully online assisted from the very beginning (2), is much faster and it is also much better evaluated by participants than alternative (1). Although such results were of course expected, the vast difference is surprising. Thus, the results definitely identify an area where more research attention is needed, particularly because it is related to the crucial step of the survey process, which is somehow much more important than series of well elaborated methodological issues with relatively minor effects on the survey process.
Workshop Homepage (abstract) / (presentation)
Web survey bibliography - 5th Internet Survey Metodology Workshop 2011 (16)
- Eye Tracking in testing questionnaires: What’s the added value?; 2011; Tries, S.
- Panel Recruitment via Facebook; 2011; Toepoel, V.
- Usability and burden measurement in online forms; 2011; Thomsen, P.
- Dynamic Data Editing in online data collection for the Vacant Positions Survey; 2011; Stax, H.-P.
- Utilizing Web Technology in Business Data Collection: Some Norwegian, Dutch and Danish Experiences; 2011; Snijkers, G., Haraldsen, G., Stax, H.-P.
- Web survey software; 2011; Slavec, A., Berzelak, N., Vehovar, V.
- Disentangling relative mode effects for the web survey mode in the Safety Monitor; 2011; Schouten, B., van de Brakel, J., Buelens, B., Klausch, L. T., van der Laan, J.
- Improving validity in web surveys with hard‐to‐reach targets: Online Respondent Driven Sampling...; 2011; Mavletova, A. M.
- Developing Electronic Questionnaires at Statistics Canada: Experiences and Challenges in a Changing...; 2011; Lawrence, D.
- Experiences with mixed mode mail & web-enquêtes in probability samples with known individuals; 2011; Kalgraff Skjak, K., Kolsrud, K.
- Effects of internet data collection in business surveys – the case of the Dutch SBS; 2011; Giesen, D.
- Ignoring the compatibility of online questionnaires may bias the psychological composition of your sample...; 2011; Funke, F.
- Video enhanced web survey; 2011; Fuchs, M., Kunz, T., Gebhard, F.
- Keeping Up Appearances: Maintaining standards during strategic changes in electronic reporting; 2011; Farrell, E., Hewett, K.
- Respondent engagement: using usability testing; 2011; Dowling, Z.
- Scrolling or paging - it depends; 2011; Blanke, K.