Web Survey Bibliography
Title Open vs. closed questions in Web surveys
Author Reja, U., Lozar Manfreda, K., Hlebec, V., Vehovar, V.
Year 2002
Access date 04.05.2004
Abstract Two quite different reasons for using open as opposed to closed questions can be distinguished. One is to discover the responses that individuals give spontaneously, the other is to avoid the bias that may result from suggesting responses to individuals. However, open questions have also their disadvantages in comparison to closed questions, such as need for extensive coding and larger item non-response. While this issue has already been well researched for traditional survey questionnaires, not much research has been devoted to it in recently used Web questionnaires. We therefore examine the differences between the two forms of survey questions by means of experiments within large-scale RIS 2001 Web survey. Three survey questions were asked in two forms in a split-ballot experiment: question on most frequently visited Slovenian and foreign Web sites, e-shops where respondents made some purchase, and the most important, critical problem the Internet is facing today. The results show that in all cases there were differences between question forms in univariate distributions, though no differences were found in the ranking of values. Closed questions in general yield higher percentages than open questions for the answers that are identical at both question forms. It seems that respondents restricted themselves with apparent ease to the alternatives offered on the closed form, whereas respondents on the open question produced a much more diverse set of answers. In addition, our results suggest that open questions produce more missing data than closed questions. Even more, there were more inadequate answers for open questions (e.g. respondents mention Slovenian Web pages on question on foreign Web pages or it is impossible to determine what the answer is about). This suggests that open questions should be more directive in wording (at least for Web surveys as self administered mode of data collection) as closed questions that are more specified with given response alternatives. We also found out that when respondents were asked about a more salient topic the differences between open and closed form were smaller. In this case both forms of questions were equivalent.
Access/Direct link Homepage - conference (abstract)
Year of publication2002
Bibliographic typeConferences, workshops, tutorials, presentations
Web Survey Bibliography - Lozar Manfreda, K. (80)
- Data quality of questions sensitive to social-desirability bias in web surveys; 2012; Lozar Manfreda, K., Zajc, N., Berzelak, N., Vehovar, V.
- Research design for studying online communities with web surveys; 2012; Petrovcic, A., Petric, G., Lozar Manfreda, K.
- Effect of different stimulus on data quality in online panels; 2012; Zagar, S., Lozar Manfreda, K.
- WEBDATANET: A Network on Web-based Data Collection, Methodological Challenges, Solutions and Implementation...; 2012; Steinmetz, S., Kaczmirek, L., de Pedraza, P., Reips, U. -D., Tijdens, K., Lozar Manfreda, K., et, al...
- Advanced Paradata in Web Surveys: What Can They Tell about the Response Process?; 2012; Vehovar, V., Slavec, A., Berzelak, N., Lozar Manfreda, K.
- Information-Communication Technology Support for Online Surveys: A Need for Integration; 2012; Vehovar, V., Slavec, A., Berzelak, N., Lozar Manfreda, K.
- Global market of web survey software: Status, trends and issues; 2012; Vehovar, V., Slavec, A., Berzelak, N., Lozar Manfreda, K.
- Paradata insight into survey response behaviour: An analysis of a set of hosted web surveys; 2012; Lozar Manfreda, K., Berzelak, N., Vehovar, V.
- Current Projects at University of Ljubljana; 2011; Lozar Manfreda, K.
- Nonresponse in Web Surveys ; 2011; Lozar Manfreda, K., Berzelak, N., Vehovar, V.
- Mobile Phones in an Environment of Competing Survey Modes: Applying Metric for Evaluation of Costs and...; 2010; Vehovar, V., Berzelak, N., Lozar Manfreda, K.
- Cost-Error Optimization Model for Mixed-Mode Surveys; 2009; Vehovar, V., Berzelak, N., Lozar Manfreda, K.
- Effectiveness of incentives in mixed-mode systems: An evaluation of errors & costs; 2009; Lozar Manfreda, K., Berzelak, N., Vehovar, V.
- Relations between functionality and usability of Web survey software tools: An empirical evaluation; 2009; Berzelak, N., Lozar Manfreda, K.
- Empirical Evaluation of Web Survey Software Tools: Powerful or Friendly?; 2009; Vehovar, V., Berzelak, N., Lozar Manfreda, K., Horvat, T., Debevc, M.
- Optimising survey costs in mixed mode environment; 2009; Vehovar, V., Berzelak, N., Lozar Manfreda, K., Belak, E.
- Effectiveness of incentives in web surveys within mixed-mode systems: An evaluation of errors & costs...; 2009; Lozar Manfreda, K.
- Effectiveness of incentives in mixed-mode systems: An evaluation of errors & costs; 2009; Vehovar, V.; Lozar Manfreda, K.; Berzelak, N.
- Internet surveys; 2008; Lozar Manfreda, K., Vehovar, V.
- What Can We Achieve With 5 Euros? Optimization of Survey Data Quality Using Mixed-Mode Approaches; 2008; Berzelak, N., Vehovar, V., Lozar Manfreda, K.
- Nonresponse in web surveys within the context of survey errors and survey costs; 2008; Berzelak, N., Lozar Manfreda, K., Vehovar, V.
- Integration of the web into survey data collection: Balancing costs and errors; 2008; Vehovar, V., Berzelak, N., Lozar Manfreda, K.
- Optimization of costs and errors in mixed-mode surveys; 2008; Vehovar, V., Berzelak, N., Lozar Manfreda, K.
- Internet Surveys; 2008; Vehovar, V., Lozar Manfreda, K.
- Overview: Online Surveys; 2008; Vehovar, V., Lozar Manfreda, K.
- Measuring ego-centered social networks on the web: Questionnaire design issues ; 2008; Vehovar, V., Lozar Manfreda, K., Koren, G., Hlebec, V.
- Internet surveys; 2008; Vehovar, V., Lozar Manfreda, K., Koren, G.
- Web Surveys versus Other Survey Modes – A Meta-Analysis Comparing Response Rates; 2008; Lozar Manfreda, K., Bosnjak, M., Berzelak, J., Haas, I., Vehovar, V.Berzelak, N.
- Nonresponse bei Web-Befragungen im Vergleich zu anderen Befragungsmodi - Eine Meta-Analytische Synthese...; 2006; Lozar Manfreda, K., Bosnjak, M., Berzelak, J., Haas, I., Vehovar, V.Berzelak, N.
- Web Survey Methodology (WebSM) Portal; 2006; Lozar Manfreda, K., Vehovar, V.
- Software tools for web surveys; 2006; Lozar Manfreda, K., Berzelak, J., Vehovar, V.
- The Quality of Survey Questions Published on Slovenian Journalistic Web Sites; 2006; Licen, S., Lozar Manfreda, K., Hlebec, V.
- Software Tools for Web Surveys: The More You Pay, the More You Get; 2006; Berzelak, J., Lozar Manfreda, K., Vehovar, V.
- A meta-analysis of response rates in Web surveys compared to other survey modes; 2005; Lozar Manfreda, K., Bosnjak, M., Haas, I., Vehovar, V.
- The Quality of Survey Questions Published on Slovenian Journalistic Websites; 2005; Licen, S., Lozar Manfreda, K., Hlebec, V.
- Web survey response rates compared to other modes - A meta-analysis; 2005; Lozar Manfreda, K., Bosnjak, M., Haas, I., Vehovar, V.
- List-based Web Surveys: Quality, Timeliness, and Nonresponse in the Steps of the Participation Flow; 2004; Pratesi, M., Lozar Manfreda, K., Biffignandi, S., Vehovar, V.
- List-based Web Surveys: Quality, Timeliness, and Nonresponse in the Steps of the Participation Flow; 2004; Pratesi, M., Lozar Manfreda, K., Biffignandi, S., Vehovar, V.
- Design issues in collecting data on ego-centered social networks on the Web; 2004; Koren, G., Hlebec, V., Vehovar, V., Lozar Manfreda, K.
- Some basic experiments on presentation of questions and response options in Web questionnaires; 2004; Lozar Manfreda, K., Koren, G., Hlebec, V.
- Collecting Data on Ego-Centered Social Networks on the Web: Methodological Issues; 2004; Lozar Manfreda, K., Koren, G., Vehovar, V., Hlebec, V.
- A meta-analysis of response rates in Web surveys compared to other survey modes; 2004; Lozar Manfreda, K., Vehovar, V.
- Mobile Phones As a Threat to The Survey Industry: An Example from Europe – The Case of Slovenia...; 2004; Vehovar, V., Lozar Manfreda, K., Dolničar, V.
- Open-ended vs. Close-ended Questions in Web Questionnaires; 2003; Reja, U., Lozar Manfreda, K., Hlebec, V., Vehovar, V.
- Collecting Data on Ego-Centered Social Networks on the Web; 2003; Koren, G., Lozar Manfreda, K., Vehovar, V., Hlebec, V.
- New Approaches Towards Collecting Data On Ego-Centered Social Networks - Interactive Web Questionnaires...; 2003; Koren, G., Hlebec, V., Lozar Manfreda, K., Vehovar, V.
- Internet and non-internet sub-networks of intensive Internet users; 2003; Hlebec, V., Lozar Manfreda, K., Vehovar, V.
- Evaluating Unit nonresponse Rates in Web Surveys - A Meta Study; 2003; Vehovar, V., Lozar Manfreda, K., Koren, G., Dolničar, V.
- Methodological issues in Web data collection of ego-centered networks; 2003; Vehovar, V., Lozar Manfreda, K., Koren, G., Hlebec, V.
- Collecting Ego-Centered Network Data via the Web; 2002; Batagelj, Z., Hlebec, V., Lozar Manfreda, K., Vehovar, V.
