Web Survey Bibliography
The apparently easy task of constructing answer formats poses many design decisions with consequences for the reliability and validity of requests. In accordance with Parduccis theoretical framework, the range of scale points and their frequency build a frame for the respondents’ understanding of what was asked and how the answer should be edited. The consequent research shows that answer scales influence respondents’ understanding regarding 1) the meaning of the concept to be measured and 2) their assumptions about the distribution of the associated behaviour or opinion in the population. Consequently, the task of designing answer scales is a complex one. While designing answer scales one should consider the properties of dimension to be measured, the appropriate scale characteristics, the modus of measurement and the characteristics of respondents. This presentation gives an overview of the literature addressing different questions related to the design of answer scales. Is an open ended or a closed answer format appropriate? What is the optimal number of scale points? What about the response order effect? How should labelling be applied? Are fully labelled scales preferable to numbered scales or end-labelled scales? Should the answer scale be polar or bipolar? Should a scale have a middle point and “no opinion” option? While regarding some of these aspects, e.g. numbers of scale points or order effects similar findings and design suggestions are available in the literature (e.g. maxim of reliability in the case of 5-7 scale points), other aspects are controversial. For example prefer some researchers an open ended question format while asking about the frequencies of certain behaviours since the answers are more exact and the context effect of answer scales is absent here. Others discuss the psychological problems associated with an open answer format, e.g. that the respondents round their answers off and build their own answer categories. Considering the presented review of literature the consequences for the design of answer scales and open research questions are summarized.
Conference Homepage (abstract)
Web Survey Bibliography - Kaczmirek, L. (69)
- Cognitive Probes in Web Surveys: On the Effect of Different Text Box Size and Probing Exposure on Response...; 2013; Behr, D., Bandilla, W., Kaczmirek, L., Braun, M.
- GESIS Online Panel Pilot: Results from a Probability-Based Online Access Panel; 2013; Kaczmirek, L., Bandilla, W., Schaurer, I., Struminskaya, B., Weyandt, K.
- Effects of incentive reduction after a series of higher incentive waves in a probability-based online...; 2013; Struminskaya, B., Kaczmirek, L., Schaurer, I., Bandilla, W.
- Sample composition discrepancies in different stages of a probability-based online panel; 2013; Bosnjak, M., Haas, I., Galesic, M., Kaczmirek, L., Bandilla, W., Couper, M. P.
- Challenges of assessing the quality of a prerecruited probability-based panel of internet users in...; 2012; Struminskaya, B., Kaczmirek, L.
- Item comparability in cross-national surveys: results from asking probing questions in cross-national...; 2012; Behr, D., Braun, M., Kaczmirek, L., Bandilla, W.
- Assessing Cross-National Equivalence of Measures of Xenophobia: Evidence from Probing in Web Surveys; 2012; Behr, D., Braun, M., Kaczmirek, L.
- The Mode of Invitation for Web Surveys; 2012; Bandilla, W., Couper, M. P., Kaczmirek, L.
- GESIS Online Access Panel Pilot Study: Recruitment and Panel Maintenance; 2012; Kaczmirek, L., Bandilla, W., Schaurer, I., Struminskaya, B., Weyandt, K.
- Panel Conditioning: Results from Two Experiments in a Probability-based Online Panel; 2012; Struminskaya, B., Kaczmirek, L., Schaurer, I., Bandilla, W.
- WEBDATANET: A Network on Web-based Data Collection, Methodological Challenges, Solutions and Implementation...; 2012; Steinmetz, S., Kaczmirek, L., de Pedraza, P., Reips, U. -D., Tijdens, K., Lozar Manfreda, K., et, al...
- The price we have to pay: Incentive experiments in the recruitment process for a probability-based online...; 2012; Schaurer, I., Struminskaya, B., Kaczmirek, L., Bandilla, W.
- Little experience with technology as a cause of nonresponse in online surveys; 2012; Struminskaya, B., Schaurer, I., Kaczmirek, L., Bandilla, W.
- Asking Probing Questions in Web Surveys: Which factors have an Impact on the Quality of Responses? ; 2012; Behr, D., Kaczmirek, L., Braun, M., Bandilla, W.
- Testing the Validity of Gender Ideology Items by Implementing Probing Questions ; 2012; Behr, D., Braun, M., Kaczmirek, L., Bandilla, W.
- Online Research @ GESIS; 2011; Kaczmirek, L., Lenzner, T.
- Seeing Through the Eyes of the Respondent: An Eye-tracking Study on Survey Question Comprehension; 2011; Lenzner, A., Kaczmirek, L., Galesic, M.
- Equivalence of Measures of Xenophobia in Cross National Survey Research: Findings Based on a Web Probing...; 2011; Bandilla, W., Behr, D., Braun, M., Kaczmirek, L., Majer, S.
- Asking sensitive questions in a recruitment interview for an online panel: the income question; 2011; Schaurer, I., Struminskaya, B., Kaczmirek, L., Bandilla, W.
- Cognitive process in answering questions: Are verbal labels in rating scales attended to?; 2011; Menold, N., Kaczmirek, L., Lenzner, T.
- Cognitive interviewing in web surveys: the use of probing questions in cross-national web surveys; 2011; Behr, D., Braun, M., Kaczmirek, L., Bandilla, W.
- Left feels right! The optimal position of answer boxes in Web surveys; 2011; Galesic, M., Kaczmirek, L., Lenzner, T., Merkert, M.
- Quality of a probability-based online panel for the social sciences in Germany: first results.; 2011; Bandilla, W., Kaczmirek, L., Schaurer, I., Struminskaya, B.
- Category Selection Probing in Online Access Panels.; 2011; Behr, D., Kaczmirek, L., Braun, M., Bandilla, W.
- Asking Sensitive Questions: Do They Affect Participation In Follow-Up Surveys?; 2011; Schaurer, I., Struminskaya, B., Kaczmirek, L., Bandilla, W.
- Which Technologies Do Respondents Use in Online Surveys – An International Comparison?; 2011; Kaczmirek, L., Behr, D., Bandilla, W.
- Developing a Research Framework for Usability in Online Surveys: Human-Survey Interaction; 2010; Kaczmirek, L.
- Attention and Usability in Internet Surveys: Effects of Visual Feedback in Grid Questions; 2010; Kaczmirek, L.
- Security and Data Protection: Collection, Storage, Feedback in Internet Research; 2010; Thiele, O., Kaczmirek, L.
- Wie empfinden Teilnehmer die Fragen in Online-Befragungen? Entwicklung eines Diktionärs für die automatische...; 2010; Kaczmirek, L., Baier, C., Züll, C.
- Social and Behavioral Research and the Internet: Advances in Applied Methods and Research Strategies; 2010; Das, M., Ester, P., Kaczmirek, L.
- Cognitive burden of survey questions and response times: A psycholinguistic experiment; 2010; Lenzner, T., Kaczmirek, L., Lenzner, A.
- What are They Asking Me? A Web Survey Experiment on Question Clarity and Measurement Error; 2009; Faas, T., Kaczmirek, L., Lenzner, A.
- Respondent-Oriented Interaction Design Reduces Item Nonresponse in Internet Surveys; 2009; Kaczmirek, L.
- Is this e-mail relevant? An eyetracking experiment on how potential respondents read e-mail invitations...; 2009; Kaczmirek, L., Faaß, T., Galesic, M.
- What are They Asking Me? A Web Survey Experiment on Question Clarity and Measurement Error; 2009; Faas, T., Kaczmirek, L., Lenzner, A.
- Respondent-Oriented Interaction Design Reduces Item Nonresponse in Internet Surveys; 2009; Kaczmirek, L.
- Panel Discussion: Does Mixed Mode Help Us Increase Response Rates?; 2009; Kaczmirek, L.
- Respondents’ Evaluations of Questionnaires: A Single-Item Open-Ended Instrument for Quality Control...; 2009; Baier, C., Kaczmirek, L., Züll, C.
- A literature review on constructing answer formats; 2009; Menold, N., Kaczmirek, L., Hoffmeyer-Zlotnik, J.
- Social Research and the Internet: Advances in Applied Methods and New Research Strategies; 2009; Das, M., Ester, P., Kaczmirek, L.
- Coverage- und Nonresponse-Effekte bei Online-Bevölkerungsumfragen ; 2009; Bandilla, W., Kaczmirek, L., Blohm, M., Neubarth, W.
- Human-Survey Interaction: Usability and Nonresponse in Online Surveys; 2008; Kaczmirek, L.
- Psycholinguistic Determinants of Question Difficulty: A Web Experiment; 2008; Faaß, T., Kaczmirek, L.
- Internet Survey Software Tools; 2008; Kaczmirek, L.
- Increasing item completion rates in matrix questions ; 2008; Kaczmirek, L.
- Prenotification in Web-Based Access Panel Surveys: The Influence of Mobile Text Messaging Versus E-Mail...; 2008; Bosnjak, M., Neubarth, W., Couper, M. P., Bandilla, W., Kaczmirek, L.
- Nicht-reaktive datenerhebung: Teinahmeverhalten bei befragungen mit paradaten evaluieren. [Non reactive...; 2007; Kaczmirek, L., Neubarth, W.
- Response time measurement in the lab and on the Web: A comparison; 2007; Galesic, M., Reips, U. -D., Kaczmirek, L., Czienskowski, U., Liske, N., von Oertzen , T.
- Applications of the Document Object Model (DOM) in Web-Surveys; 2007; Neubarth, W., Kaczmirek, L.
