Web Survey Bibliography
Title Response Order Effects in International Online Surveys
Author Thomas, R. K., Greenfield, S., Bremer, J.
Year 2006
Access date 24.09.2006
Abstract While response order effects have been demonstrated in orally presented surveys and paper-pencil/postal surveys (Krosnick, 1999), little work has been reported on response order effects for attitude measures in online surveys. In a series of online surveys with U.S. respondents, Thomas et al. (AAPOR, 2005) reported strong response order effects across scale types for vertically ordered scales. In this paper, we summarize a series of experiments conducted internationally (Belgium, France, Germany, Italy, Spain, and U.K.) with web-based surveys with single vertically presented scales. Across experiments, with scales that varied from 4 to 9 categories, and across languages and countries, we replicated strong response order effects for vertically oriented scales. That is, there is a higher endorsement of the most positive response category when it is presented on the top of the scale than when it is presented on the bottom. In many of the studies we also examined the correspondence of the scales with key criteria to determine the possibility of differential validity. Vertical scales with the negative response category on top generally had higher validity. We will discuss possible reasons for response order effects (including satisficing and reading mechanics for visual surveys) and examine some implications of response order effects for survey construction.
Access/Direct link Conference homepage (abstract)
Year of publication2006
Bibliographic typeConferences, workshops, tutorials, presentations
Full text availabilityNon-existant
Web Survey Bibliography - United Kingdom (342)
- The use of cognitive interviewing methods to evaluate mode effects in survey questions; 2011; Gray, M., Blake, M., Campanelli, P., Hope, S.
- Is it a good idea to optimise question format for mode of data collection? Results from a mixed modes...; 2011; Nicolaas, G., Campanelli, P., Hope, S., Jaeckle, A., Lynn, P., Nandi, A.
- The role of the interviewer in producing mode effects: results from a mixed modes experiment; 2011; Hope, S., Campanelli, P., Nicolaas, G., Lynn, P., Jaeckle, A., Nandi, A.
- The role of visual and aural stimuli in producing mode effects on answers to survey questions; 2011; Lynn, P., Hope, S., Campanelli, P., Nandi, A., Nicolaas, G., Jaeckle, A.
- Causes of Mode Effects on Survey Measurement ; 2011; Lynn, P., Campanelli, P., Nicolaas, G., Hope, S., Nandi, A., Jaeckle, A.
- The effects of mixed mode designs on simple and complex analyses; 2011; Martin, P., Lynn, P.
- The use of email‐facilitated interviewing with higher functioning autistic people participating...; 2011; Benford, P., Standen, P.
- Multiple modes in cross-national surveys – a good mix?; 2011; Fitzgerald, R., Martin, P.
- Assessing mode effects: implications of embedding a children's quality of life questionnaire within...; 2011; Lloyd, K.
- Survey Response via Mobile Phone: A Total Survey Error Perspective; 2011; Kaminska, O., Lynn, P.
- Usability testing of market research questionnaires; 2011; Coombe, R., Jarrett, C., Johnson, A.
- Applying maximum entropy weighting to on line panel data collection; 2011; Bianchi, A., Biffignandi, S., Hartmann, E., Sekhon, J.
- Are reluctant panelists worth the effort? Analysis of measurement error in a probability-based Internet...; 2011; Allum, N., Roberts, C., Sturgis, P.
- Indicators for Monitoring and Improving Representativeness of Response; 2011; Schouten, B., Shlomo, N., Skinner, C.
- Using the Internet for speech research: an evaluative study examining affect in speech; 2011; Knoll, M. A., Uther, M., Costall, A.
- Kids' Life and Times: using an Internet survey to measure children's health-related quality...; 2011; Lloyd, K.
- The effect of the internet on researcher motivations, behaviour and attitudes; 2011; Mulligan, A., Mabe, M.
- Online qualitative approaches: an appraisal; 2011; Parker, K.
- A web-based survey on mephedrone; 2011; Carhart-Harris, R. L., King, L. A., Nutt, D. J.
- Factorial trial found mixed evidence of effects of pre-notification and pleading on response to Web-...; 2011; Felix, L. M., Burchett, H. E., Edwards, P. J.
- Advantages and limitations of web-based surveys: evidence from a child mental health survey; 2011; Heiervang, E., Goodman, R.
- The psychology of survey response, 2nd Edition; 2010; Tourangeau, R., Bradburn, N. M.
- Social measurement through social surveys. An applied approach; 2010; Bulmer, M. et al.
- Designing questions for mixed mode data collection: What have we learnt so far?; 2010; Nicolaas, G., Campanelli, P.
- The Internet, Electoral Politics and Citizen Participation in Global Perspective; 2010; Gibson, R., Cantijoch, M.
- Continuity and Innovation in the Design of Understanding Society: the UK Household Longitudinal Study...; 2010; Laurie, H.
- Weighting Strategy for Understanding Society; 2010; Lynn, P., Kaminska, O.
- Lessons from a Randomised Experiment with Mixed-Mode Designs for a Household Panel Survey; 2010; Lynn, P., Uhrig, S.C. N., Burton, J.
- Understanding Society Innovation Panel Wave 2: Results from Methodological Experiments ; 2010; Burton, J., Laurie, H., Uhrig, S.C. N.
- Mobile Experience Sampling: Reaching the Parts of Facebook Other Methods Cannot Reach; 2010; Abdesslem, F. B., Parris, I., Henderson, T.
- Elastic-R, a Google docs-like portal for data analysis in the Cloud ; 2010; Chine, K.
- Is there a future for “real” qualitative market research interviewing in the digital age...; 2010; McPhee, N.
- Qualitative and Qualitative Longitudinal Resources in Europe; 2010; Bishop, L., Neale, B.
- Mobile Research: New Platform, New Thinking ; 2010; Johnson, A. J., Conry, S.
- Managing Quality in Large Multi-Country / Multi-Category / Multi-Modal Studies; 2010; Thompson, J.
- Mobile Research – The future’s in their hands: Exploring the Application of Digital Research...; 2010; Dodgson, S.
- Conditioning Effects in Online Communities; 2010; Cape, P. J.
- Kids' Life and Times: Using the Internet to Give Children a Voice; 2010; Lloyd, K.
- Thoughts on the rise and future of online research ; 2010; Day, D.
- Trial by Ordeal, a medieval approach to a modern day problem; 2010; Cape, P., Cavallaro, K.
- Developing a Research Framework for Usability in Online Surveys: Human-Survey Interaction; 2010; Kaczmirek, L.
- A Study Of Technology Adoption By Researchers: Web and e-science infrastructures to enhance research...; 2010; Pearce, N.
- Using the Internet to Give Children a Voice: An Online Survey of 10-and 11-Year-Old Children in Northern...; 2010; Lloyd, K., Devine, P.
- The ESRC Survey Resources Network - Opportunities for the advancement of survey methods; 2010; Lynn, P., Erens, B.
- The use of web questionnaires in second language acquisition and bilingualism research; 2010; Wilson, R., Dewaele, J. M.
- A mixed-mode approach to data collection: combining web and paper questionnaires to examine nurses&#...; 2010; Guise, V., Chambers, M., Välimäki, M., Makkonen, P.
- Use of an online questionnaire for follow-up of young female students recruited to a randomised controlled...; 2010; Atherton, H., Oakeshott, P., Aghaizu, A., Hay, P., Kerry, S.
- Effects of a Financial Incentive on Health Researchers’ Response to an Online Survey: a Randomized...; 2010; Wilson, P. M., Petticrew, M., Calnan, M., Nazareth, I.
- MarketTools TrueSample; 2009
- Sample Design for Understanding Society ; 2009; Lynn, P.