Web Survey Bibliography
Response categories may be used differently as a result of ethnic background or country of residence. When making comparisons between countries, there are a number of factors (e.g. mode, demographics, etc.) that must be equated before we can attribute differences due to culture and not other factors. Scale polarity is one issue that can cause some differences between countries – bipolar scales may sometimes be inappropriately rendered as unipolar scales (and vice versa) in translations. In this study, we compared scale variants (e.g. unipolar versus bipolar) and extent of semantic anchoring (fully anchored versus end anchored scales) in leading to differences between countries. This experiment had 36,938 respondents from 6 different European countries complete a web-based survey on attitudes and behaviors toward different activities. Respondents were randomly assigned to 1 of 4 scale conditions to rate in terms of their liking for the activity (fully versus end anchored crossed with unipolar versus bipolar). They were first asked how many days they did a series of actions and then evaluated their attitudes toward the actions (e.g. drinking coffee, attending religious services, etc.). We found significant differences in endorsement proportions for the response categories as a function of scale type. The fully anchored unipolar scale showed a lower endorsement of the highest response categories across countries. There were mean differences in the evaluations of the issues as a function of country. However, controlling for familiarity with the topic and demographic factors, we found that these differences between countries was eliminated or reduced for most of the activities we examined. We found significant differences in response style proportions (extreme versus middling response styles) as a result of country of residence. However, response style differences between countries were more likely to occur for the end-anchored scales and not for the fully anchored scales.
Conference Homepage (abstract)
Web survey bibliography (20)
- Retrospective Measurement of Students’ Extracurricular Activities with a Self-administered Calendar...; 2016; Furthmueller, P.
- A multi-group analysis of online survey respondent data quality: Comparing a regular USA consumer panel...; 2016; Golden, L.; Albaum, G.; Roster, C. A.; Smith, S. M.
- Investigating respondent multitasking in web surveys using paradata; 2016; Sendelbah, A.; Vehovar, V.; Slavec, A.; Petrovcic, A.
- Rating Scales in Web Surveys: A Test of New Drag-and-Drop Rating Procedures; 2015; Kunz, T.
- Relative Mode Effects on Data Quality in Mixed-Mode Surveys by an Instrumental Variable; 2013; Vannieuwenhuyze, J. T. A., Revilla, M.
- Effects of Response Format on Measurement of Readership; 2013; Thomas, R. K., Cobb, C. L., Baim, J.
- Ebook readings jumps, print book reading declines; 2012; Rainie, L., Duggan, M.
- Using e-surveys to access the views of football fans within online communities; 2012; Gibbons, T., Nuttall, D.
- Exploring New Pathways to Survey Recruitment; 2012; Bilgram, V., Stadler, D.Jawecki, G.
- Cross-country Comparisons: Effects of Scale Type and Response Style Differences; 2011; Thomas, R. K.
- Separation of selection bias and mode effect in mixed-mode survey – Application to the face-to...; 2011; Bayart, C., Bonnel, P.
- Movie Mobile Polls: Does Survey Mode Make a Difference?; 2010; Williams, Do.
- 3 screen measurement: Soccer World Cup 2010; 2010; Conry, S., Benezra, K., Singh, S.
- Communicating Disclosure Risk in Informed Consent Statements; 2010; Singer, E., Couper, M. P.
- Does Providing a Choice of Survey Modes Influence Response?; 2010; Lesser, V. M., Newton, L., Yang, D.
- Can a professional questionnaire layout make up for a boring topic? The mediating role of topic interest...; 2010; Keusch, F., Mayerhofer, W., Jungreithmaier, S., Weilbuchner, N., Fuehrer, R., Kling, H.
- Designing Culturally Neutral Storyboard: A Case Study of Designing an Online Survey with Storyboards; 2010; Koponen, T., Varsaluoma, J., Walsh, T.
- Continuous Measurement of Musically-Induced Emotion: A Web Experiment ; 2009; Egermann, H., Nagel, F., Altenmueller, E., Kopiez, R.
- E-epidemiology : Adapting epidemiological methods for the 21st century; 2009; Bexelius, C.
- The Use of Online Methodologies in Data Collection for Gambling and Gaming Addictions; 2009; Griffiths, M. D.
- Usability Testing of Web Data Collection Instruments; 2002; Thalji, L., Antunes, M. J., Wiebe, E. F.