Web Survey Bibliography
Ample empirical evidence suggests that prenotification is an important method to increase response rates in mail surveys. However, for Web-based surveys, the results on prenotification appear to be mixed. One explanation may be the lack of awareness of the initial e-mail contacts. For instance, automatic spam filters and unidentified senders of the prenotifications could lower the chance of the e-mail being noticed. To increase awareness when contacting participants for Web-based surveys, it might be more effective to send the invitations directly to the respondents’ cellular phones. This method seems most promising with younger persons in Germany, because this segment has near-universal cellular phone coverage. To compare the effectiveness of different prenotification procedures, we experimentally varied the initial contact mode in a fully crossed two-factorial design with (1) three different prenotification conditions and (2) two ‘invitation and reminder’ conditions. University freshmen were recruited for a Web-based access panel by completing a short paper and pencil questionnaire in a classroom setting consisting of basic demographics, psychographics, and questions about lifestyles. A total of 560 students were randomly assigned to one of the following experimental conditions: On the prenotification factor, one group received no prenotification at all, a second was contacted by mobile messaging (SMS) on their mobile phone, and a third group was contacted by e-mail, both announcing the prospective survey. For the survey invitation and reminder, respondents were randomly contacted either by e-mail or by SMS. Our paper will point out the influences of the experimental manipulations on various measures related to data quality. For example, response rates varied between 50% and 84% across the experimental conditions, with the combination of SMS prenotification and e-mail invitation performing the best. However, the use of SMS invitations led to quicker responses. Besides further elaborating on these results, we will also point out the influences of the experimental manipulations on sample composition and the responses to the substantive questions. Finally, practical implications for contacting participants of Web-based access panels in marketing and social research will be discussed.
Web Survey Bibliography - Kaczmirek, L. (69)
- Cognitive Probes in Web Surveys: On the Effect of Different Text Box Size and Probing Exposure on Response...; 2013; Behr, D., Bandilla, W., Kaczmirek, L., Braun, M.
- GESIS Online Panel Pilot: Results from a Probability-Based Online Access Panel; 2013; Kaczmirek, L., Bandilla, W., Schaurer, I., Struminskaya, B., Weyandt, K.
- Effects of incentive reduction after a series of higher incentive waves in a probability-based online...; 2013; Struminskaya, B., Kaczmirek, L., Schaurer, I., Bandilla, W.
- Sample composition discrepancies in different stages of a probability-based online panel; 2013; Bosnjak, M., Haas, I., Galesic, M., Kaczmirek, L., Bandilla, W., Couper, M. P.
- Challenges of assessing the quality of a prerecruited probability-based panel of internet users in...; 2012; Struminskaya, B., Kaczmirek, L.
- Item comparability in cross-national surveys: results from asking probing questions in cross-national...; 2012; Behr, D., Braun, M., Kaczmirek, L., Bandilla, W.
- Assessing Cross-National Equivalence of Measures of Xenophobia: Evidence from Probing in Web Surveys; 2012; Behr, D., Braun, M., Kaczmirek, L.
- The Mode of Invitation for Web Surveys; 2012; Bandilla, W., Couper, M. P., Kaczmirek, L.
- GESIS Online Access Panel Pilot Study: Recruitment and Panel Maintenance; 2012; Kaczmirek, L., Bandilla, W., Schaurer, I., Struminskaya, B., Weyandt, K.
- Panel Conditioning: Results from Two Experiments in a Probability-based Online Panel; 2012; Struminskaya, B., Kaczmirek, L., Schaurer, I., Bandilla, W.
- WEBDATANET: A Network on Web-based Data Collection, Methodological Challenges, Solutions and Implementation...; 2012; Steinmetz, S., Kaczmirek, L., de Pedraza, P., Reips, U. -D., Tijdens, K., Lozar Manfreda, K., et, al...
- The price we have to pay: Incentive experiments in the recruitment process for a probability-based online...; 2012; Schaurer, I., Struminskaya, B., Kaczmirek, L., Bandilla, W.
- Little experience with technology as a cause of nonresponse in online surveys; 2012; Struminskaya, B., Schaurer, I., Kaczmirek, L., Bandilla, W.
- Asking Probing Questions in Web Surveys: Which factors have an Impact on the Quality of Responses? ; 2012; Behr, D., Kaczmirek, L., Braun, M., Bandilla, W.
- Testing the Validity of Gender Ideology Items by Implementing Probing Questions ; 2012; Behr, D., Braun, M., Kaczmirek, L., Bandilla, W.
- Online Research @ GESIS; 2011; Kaczmirek, L., Lenzner, T.
- Seeing Through the Eyes of the Respondent: An Eye-tracking Study on Survey Question Comprehension; 2011; Lenzner, A., Kaczmirek, L., Galesic, M.
- Equivalence of Measures of Xenophobia in Cross National Survey Research: Findings Based on a Web Probing...; 2011; Bandilla, W., Behr, D., Braun, M., Kaczmirek, L., Majer, S.
- Asking sensitive questions in a recruitment interview for an online panel: the income question; 2011; Schaurer, I., Struminskaya, B., Kaczmirek, L., Bandilla, W.
- Cognitive process in answering questions: Are verbal labels in rating scales attended to?; 2011; Menold, N., Kaczmirek, L., Lenzner, T.
- Cognitive interviewing in web surveys: the use of probing questions in cross-national web surveys; 2011; Behr, D., Braun, M., Kaczmirek, L., Bandilla, W.
- Left feels right! The optimal position of answer boxes in Web surveys; 2011; Galesic, M., Kaczmirek, L., Lenzner, T., Merkert, M.
- Quality of a probability-based online panel for the social sciences in Germany: first results.; 2011; Bandilla, W., Kaczmirek, L., Schaurer, I., Struminskaya, B.
- Category Selection Probing in Online Access Panels.; 2011; Behr, D., Kaczmirek, L., Braun, M., Bandilla, W.
- Asking Sensitive Questions: Do They Affect Participation In Follow-Up Surveys?; 2011; Schaurer, I., Struminskaya, B., Kaczmirek, L., Bandilla, W.
- Which Technologies Do Respondents Use in Online Surveys – An International Comparison?; 2011; Kaczmirek, L., Behr, D., Bandilla, W.
- Developing a Research Framework for Usability in Online Surveys: Human-Survey Interaction; 2010; Kaczmirek, L.
- Attention and Usability in Internet Surveys: Effects of Visual Feedback in Grid Questions; 2010; Kaczmirek, L.
- Security and Data Protection: Collection, Storage, Feedback in Internet Research; 2010; Thiele, O., Kaczmirek, L.
- Wie empfinden Teilnehmer die Fragen in Online-Befragungen? Entwicklung eines Diktionärs für die automatische...; 2010; Kaczmirek, L., Baier, C., Züll, C.
- Social and Behavioral Research and the Internet: Advances in Applied Methods and Research Strategies; 2010; Das, M., Ester, P., Kaczmirek, L.
- Cognitive burden of survey questions and response times: A psycholinguistic experiment; 2010; Lenzner, T., Kaczmirek, L., Lenzner, A.
- What are They Asking Me? A Web Survey Experiment on Question Clarity and Measurement Error; 2009; Faas, T., Kaczmirek, L., Lenzner, A.
- Respondent-Oriented Interaction Design Reduces Item Nonresponse in Internet Surveys; 2009; Kaczmirek, L.
- Is this e-mail relevant? An eyetracking experiment on how potential respondents read e-mail invitations...; 2009; Kaczmirek, L., Faaß, T., Galesic, M.
- What are They Asking Me? A Web Survey Experiment on Question Clarity and Measurement Error; 2009; Faas, T., Kaczmirek, L., Lenzner, A.
- Respondent-Oriented Interaction Design Reduces Item Nonresponse in Internet Surveys; 2009; Kaczmirek, L.
- Panel Discussion: Does Mixed Mode Help Us Increase Response Rates?; 2009; Kaczmirek, L.
- Respondents’ Evaluations of Questionnaires: A Single-Item Open-Ended Instrument for Quality Control...; 2009; Baier, C., Kaczmirek, L., Züll, C.
- A literature review on constructing answer formats; 2009; Menold, N., Kaczmirek, L., Hoffmeyer-Zlotnik, J.
- Social Research and the Internet: Advances in Applied Methods and New Research Strategies; 2009; Das, M., Ester, P., Kaczmirek, L.
- Coverage- und Nonresponse-Effekte bei Online-Bevölkerungsumfragen ; 2009; Bandilla, W., Kaczmirek, L., Blohm, M., Neubarth, W.
- Human-Survey Interaction: Usability and Nonresponse in Online Surveys; 2008; Kaczmirek, L.
- Psycholinguistic Determinants of Question Difficulty: A Web Experiment; 2008; Faaß, T., Kaczmirek, L.
- Internet Survey Software Tools; 2008; Kaczmirek, L.
- Increasing item completion rates in matrix questions ; 2008; Kaczmirek, L.
- Prenotification in Web-Based Access Panel Surveys: The Influence of Mobile Text Messaging Versus E-Mail...; 2008; Bosnjak, M., Neubarth, W., Couper, M. P., Bandilla, W., Kaczmirek, L.
- Nicht-reaktive datenerhebung: Teinahmeverhalten bei befragungen mit paradaten evaluieren. [Non reactive...; 2007; Kaczmirek, L., Neubarth, W.
- Response time measurement in the lab and on the Web: A comparison; 2007; Galesic, M., Reips, U. -D., Kaczmirek, L., Czienskowski, U., Liske, N., von Oertzen , T.
- Applications of the Document Object Model (DOM) in Web-Surveys; 2007; Neubarth, W., Kaczmirek, L.
