Web Survey Bibliography
Relevance & Research Question: When asking respondents questions with long lists of response options allowing multiple answers response order effects may occur. In Web surveys, primacy effects are to be expected due to their self-administered nature since the respondents’ attention declines when reading long lists of response options. Instructions asking respondents to process all response options to the same extent have only limited effect. Web surveys offer the opportunity to make use of dynamic tools that have the potential to increase the respondents’ attention to such instructions. Among others, tooltips are an effective method to direct the respondents’ attention to specific elements of a question, in particular to instructions.
Methods & Data: The effect of tooltip instructions was tested in a randomized 2x4 between-subjects experiment embedded in a survey among university applicants (n=6.000). Factor 1 included the order in which a long list of 13 response options was presented (original vs. reversed order). Factor 2 referred to four different ways of presenting the instruction (control condition without instruction, static instruction displayed underneath the question, dynamic tooltip instruction appearing each time a respondent hovered the mouse pointer over a response option, and a combined condition integrating both a static and a dynamic tooltip instruction). For each condition we computed response order effects and compared their magnitude in order to assess the effectiveness of the instruction as compared to the control condition.
Results: Findings indicate that the average response order effect as well as the number of significant effects can be reduced using dynamic tooltip instructions. The reduction is about the same as compared to the effect achieved by a static instruction. When combining the two means of presenting the instruction (static and dynamic) the reduction in response order effects is even more pronounced.
Added Value: The study demonstrates the benefits of using dynamic feedback to respondents in Web surveys. Using tooltip technology works as a continuous stimulus throughout the question-answer process. However, dynamic instructions are not a substitute for static instructions, instead, findings suggest a particular effectiveness of using dynamic instructions jointly with conventional instructions.
GOR Homepage (abstract) / (presentation)
Web survey bibliography - Fuchs, M. (33)
- Dynamic Instructions in Check-All-That-Apply Questions ; 2016; Kunz, T.; Fuchs, M.
- The Mobile Web Only Population: Socio-demographic Characteristics and Potential Bias ; 2016; Fuchs, M.; Metzler, A.
- The use and positioning of clarification features in web surveys; 2016; Metzler, A., Kunz, T., Fuchs, M.
- Recruiting Respondents for a Mobile Phone Panel: The Impact of Recruitment Question Wording on Cooperation...; 2015; Busse, B.; Fuchs, M.
- Nonresponse and Measurement Bias in Web surveys ; 2015; Metzler, A.; Fuchs, M.
- Positioning of Clarification Features in Open Frequency and Open Narrative Questions; 2015; Fuchs, M.; Metzler, A.
- Instant Interactive Feedback in Grid Questions: Reminding Web Survey; 2014; Kunz, T., Fuchs, M.
- Respondent Choice of Survey Mode; 2013; Fuchs, M.
- Using Eye Tracking Data to Understand Respondent's Processing of Rating Scales; 2013; Kunz, T., Fuchs, M.
- Dynamic Visual Design for List-Style Open-Ended Questions in Web Surveys; 2013; Fuchs, M.
- Using interactive feedback to enhance response quality in Web surveys. The case of open-ended questions...; 2013; Emde, M., Fuchs, M.
- Reducing Response Order Effects in Check-All-That-Apply Questions by Use of Dynamic Tooltip Instructions...; 2013; Kunz, T., Fuchs, M.
- Effects of Static versus Dynamic Formatting Instructions for Open-Ended Numerical Questions in Web Surveys...; 2012; Kunz, T., Fuchs, M.
- Exploring Animated Faces Scales in Web Surveys: Drawbacks and Prospects; 2012; Emde, M., Fuchs, M.
- Video enhanced web survey; 2011; Fuchs, M., Kunz, T., Gebhard, F.
- The Coverage Bias of Mobile Web Surveys; 2009; Fuchs, M.
- The Coverage Bias of Mobile Web Surveys Across European Countries ; 2009; Fuchs, M., Busse, B.
- Are people sharing their mobile phones? Selection probabilities in cellular telephone surveys; 2009; Fuchs, M., Busse, B.
- Is a cell phone really a personal device? Results from the first wave of a mobile phone panel on sharing...; 2009; Fuchs, M., Busse, B.
- Are Respondents Sharing their Mobile Phones? Preliminary results based on a mobile phone panel in Germany...; 2009; Fuchs, M.
- Dynamic feedback in open-ended questions: Experiments on the visual design language of Web surveys; 2009; Fuchs, M.
- The relative coverage bias caused by the mobile-only population across Europe; 2009; Fuchs, M.
- The Video-Enhanced Web Survey Data Quality and Cognitive Processing of Questions; 2009; Fuchs, M.
- Gender-of-Interviewer Effects in a Video-Enhanced Web Survey: Results from a Randomized Field Experiment...; 2009; Fuchs, M.
- Mobile web surveys: A preliminary discussion of methodological implications; 2008; Fuchs, M.
- Response Effects in Video-enhanced Web Surveys; 2008; Fuchs, M.
- The relative Coverage Error in Telephone Surveys caused by Mobile-Only Populations across Europe; 2008; Fuchs, M.
- Communicative Channels, Cognitive Processes and Question Understanding: Results from a Randomized Field...; 2008; Fuchs, M.
- Gender-of-Interviewer Effects in Video-Enhanced Web Surveys. Results from a Randomized Field-Experiment...; 2008; Fuchs, M.
- Using Audio and Video Clips in Web Surveys — Feasibility and Impact on Data Quality; 2007; Fuchs, M., Funke, F.
- Cognitive processes when answering online questionnaires; 2002; Fuchs, M.
- Cognitive processes in Web Surveys; 2002; Fuchs, M.
- Technology Effects: Do CAPI or PAPI Interviews Take Longer?; 2000; Fuchs, M., Couper, M. P., Hansen, S. E.