Web Survey Bibliography
Title Some basic experiments on presentation of questions and response options in Web questionnaires
Source RC33 6th International Conference on Social Science Methodology: Recent Developments and Applications in Social Research Methodology, 2004
Access date 14.09.2004
Abstract Survey methodologists already performed some tests on Web questionnaire design for efficient data collection. However, in comparison to the amount of research dealing with questionnaires in other survey modes these studies present only a first step in systematic research on the possible effects of the Web questionnaire on non-response and measurement errors. Our study contributes to this body of knowledge on designing principles of Web questionnaires. We deal with some basic principles on how to present individual questions and response options. We focus on the following questions: - What are the differences in substantive results and data quality when presenting an open question, a close question with a drop-down menu, and a close question with an ordinary list of responses? - What is the order effect when response options are rotated and when not? - How does the size of the text entry box influence responses to an open question? - How does the presentation of a Likert scale set of questions in a grid table or separately (each question on its own screen) influence data? - What is the effect of different types of scale response options: an 11- point scale with a middle point (-5 to 5 with 0) vs. a 10-point scale without a middle point (-5 to 5 without 0) vs. a 10-point scale divided to two scales with a filter question first? - What are the differences in substantive results from ordinary attitude questions vs. questions with a filter question first excluding respondents with no attitude towards a certain matter? Experiments addressing these issues were implemented in a Web survey among the first grade students at the Faculty of Social Sciences, Slovenia, in fall 2001. 350 respondents were randomly administered to different experimental conditions using split-ballot design. For each of the above research questions respondents were randomly assigned to two or three groups being administered a different version of the individual questions. We will show that some of the basic principles for designing self-administered questionnaires from paper-and-pencil self-administered modes hold true also for Web surveys. However, also specifics - for example the effect of introducing drop-down menus (which cannot be implemented within paper questionnaires) – can occur. We must regard the Web as a special medium with special design options, visual features and required respondent's actions. These all require a special treatment of the Web questionnaire.
Bibliographic typeConferences, workshops, tutorials, presentations
Year of publication2004
Web Survey Bibliography - Slovenia (109)
- Exploring patterns of academic usage: A Google Scholar based study of ESS, EVS, WVS and ISSP academic...; 2013; Malnar, B.
- Data quality of questions sensitive to social-desirability bias in web surveys; 2012; Lozar Manfreda, K., Zajc, N., Berzelak, N., Vehovar, V.
- WebSM Study: Survey software features overview ; 2012; Vehovar, V.; Cehovin, G.; Kavcic, L.; Lenar, J.
- Costs and Errors in Fixed and Mobile Phone Surveys; 2012; Vehovar, V., Slavec, A., Berzelak, N.
- Impact of Fixed Choice Design on Blockmodeling Outcomes; 2012; Znidarsic, A.
- Web Survey Software; 2012; Berzelak, N., Vehovar, V., Slavec, A.
- Surveying general population: What types of experiments are further needed?; 2012; Vehovar, V., Berzelak, N.
- Research design for studying online communities with web surveys; 2012; Petrovcic, A., Petric, G., Lozar Manfreda, K.
- Effect of different stimulus on data quality in online panels; 2012; Zagar, S., Lozar Manfreda, K.
- Web panels in Slovenia; 2012; Lenar, J., Vehovar, V.
- Adaptation of Cognitive Interviews for Web; 2012; Mohorko, A., Hlebec, V.
- Advanced Paradata in Web Surveys: What Can They Tell about the Response Process?; 2012; Vehovar, V., Slavec, A., Berzelak, N., Lozar Manfreda, K.
- Information-Communication Technology Support for Online Surveys: A Need for Integration; 2012; Vehovar, V., Slavec, A., Berzelak, N., Lozar Manfreda, K.
- Global market of web survey software: Status, trends and issues; 2012; Vehovar, V., Slavec, A., Berzelak, N., Lozar Manfreda, K.
- Paradata insight into survey response behaviour: An analysis of a set of hosted web surveys; 2012; Lozar Manfreda, K., Berzelak, N., Vehovar, V.
- Current Projects at University of Ljubljana; 2011; Lozar Manfreda, K.
- Web survey software; 2011; Slavec, A., Berzelak, N., Vehovar, V.
- Web Survey Process within the Concept of eSocial Sciences; 2011; Vehovar, V.
- The Impact of Non-Response Treatments on the Stability of Blockmodels; 2011; Znidarsic, A., Ferligoj, A., Doreian, P.
- The influence of Social Support and Personal Networks on Doctoral Student Performance; 2011; Hlebec, V., Kogovsek, T., Ferligoj, A.
- From Busy Bees to Science Geeks and Party Animals: A Typology of Slovenian Doctoral Students; 2011; Hlebec, V., Kogovsek, T., Ferligoj, A.
- PhD Students’ Research Group Social Capital in Two Countries: A Clustering Approach with Duocentred...; 2011; Coenders, G., Coromina, L., Ferligoj, A., Guia, J.
- The Structural Changes of Social Support Networks in a Decade of the Internet Uptake in Slovenia; 2011; Vehovar, V., Petric, G., Petrovčič, A.
- How to ask about fixed/mobile telephone usage? Impact of question wording and analysis of corresponding...; 2011; Slavec, A., Vehovar, V.
- Optimization of dual frame telephone survey designs; 2011; Slavec, A., Vehovar, V.
- Costs Error Optimization for Cell-Landline Dual Frame Surveys.; 2011; Slavec, A.; Vehovar, V.
- Nonresponse in Web Surveys ; 2011; Lozar Manfreda, K., Berzelak, N., Vehovar, V.
- Sources of measurement errors in business surveys; 2010; Bavdaz, M.
- Archiving and Re-using Qualitative and Qualitative Longitudinal Data in Slovenia; 2010; Stebe, J., Hudales, J., Kragelj, B.
- Mobile Phones in an Environment of Competing Survey Modes: Applying Metric for Evaluation of Costs and...; 2010; Vehovar, V., Berzelak, N., Lozar Manfreda, K.
- Effectiveness of incentives in mixed-mode systems: An evaluation of errors & costs; 2009; Lozar Manfreda, K., Berzelak, N., Vehovar, V.
- National readership surveys: Moving from probability face-to-face surveys to Internet panels; 2009; Vehovar, V., Slavec, A., Petric, I., Sargac, M.
- Relations between functionality and usability of Web survey software tools: An empirical evaluation; 2009; Berzelak, N., Lozar Manfreda, K.
- Optimising survey costs in mixed mode environment; 2009; Vehovar, V., Berzelak, N., Lozar Manfreda, K., Belak, E.
- Effectiveness of incentives in web surveys within mixed-mode systems: An evaluation of errors & costs...; 2009; Lozar Manfreda, K.
- Effectiveness of incentives in mixed-mode systems: An evaluation of errors & costs; 2009; Vehovar, V.; Lozar Manfreda, K.; Berzelak, N.
- "Mobile phone surveys in mixed mode environment: Balancing costs and errors"; 2009; Vehovar, V.
- Mobile phone surveys in mixed mode environment; 2009; Vehovar, V.
- Towards a flexible online mixed method design with a feedback loop; 2009; Lobe, B., Vehovar, V.
- What Can We Achieve With 5 Euros? Optimization of Survey Data Quality Using Mixed-Mode Approaches; 2008; Berzelak, N., Vehovar, V., Lozar Manfreda, K.
- Measuring ties on online forums; 2008; Ziberna, A., Vehovar, V., Jakulin, A.
- Integration of the web into survey data collection: Balancing costs and errors; 2008; Vehovar, V., Berzelak, N., Lozar Manfreda, K.
- Measuring ego-centered social networks on the web: Questionnaire design issues ; 2008; Vehovar, V., Lozar Manfreda, K., Koren, G., Hlebec, V.
- Web Surveys versus Other Survey Modes – A Meta-Analysis Comparing Response Rates; 2008; Lozar Manfreda, K., Bosnjak, M., Berzelak, J., Haas, I., Vehovar, V.
- Fitting disposition codes to mobile phone surveys: experiences from studies in Finland, Slovenia and...; 2007; Callegaro, M., Buskirk, T. D., Vehovar, V., Kuusela, V., Piekarski, L., Steeh, C. G.
- Peeping Over Computers The Slovenian Internet Audience Measurement Mix Model ; 2007; Cucin, P., Kropivnik, S., Hocevar, J.
- Social Aspects of Mobile Phone Usage and Their Impact on Survey Cooperation; 2007; Vehovar, V., Callegaro, M.
- Web Survey Methodology (WebSM) Portal; 2006; Lozar Manfreda, K., Vehovar, V.
- Reliability and Validity of Measuring Social Support Networks by Web and Telephone; 2006; Kogovsek, T.
- Flexibility of FOMM (Flexible Online Mixed Methods Design with a Feed-back Loop); 2006; Lobe, B., Vehovar, V.