Web Survey Bibliography
Derived from cognitive psychology and adapted to the context of questionnaire development, cognitive interviewing methods have been extensively used to pre-test survey questions. Usually the researcher/questionnaire designer uses cognitive interviewing methods in the questionnaire development stage as a qualitative tool to test specific questions by establishing whether respondents interpret the questions consistently and in the way intended (comprehension). The method is also used to explore recall, judgment and response issues.
As part of a wider Economic and Social Research Council (ESRC) grant funded project, which involved experiments comparing respondents’ answers to survey questions in different modes, cognitive interviews were used as a follow up methodology to explore in more detail how mode effects happen even if they are not directly observed. Selected respondents from the quantitative experiments took part in cognitive interviews where questions were administered face to face, by phone and by web, and were followed by a retrospective think aloud. The focus of the think-aloud (used in combination with some pre-scripted probes) was not on what respondents understood by certain words or answer categories but was instead on how they had gone about answering questions in the different data collection modes.
The paper will focus on the methods used in these mixed modes cognitive interviews which involved an element of mode mimicking, how the interviews differed from standard cognitive interviewing for question testing, identifying the benefits and limitations of the approach taken, and drawing out lessons for using think aloud methods in unusual ways.
Conference Homepage (abstract)
Web Survey Bibliography - Mixed mode surveys (959)
- Measurement error calibration in mixed-mode sample surveys; 2013; Buelens, B., van der Brakel, J.
- Optimal Resource Allocation in Adaptive Survey Designs; 2013; Calinescu, M.
- Flexible insulin dosing improves health-related quality-of-life (HRQoL): a time trade-off survey; 2013; Evans, M. et al.
- Where does the Fair Trade price premium go? Confronting consumers' request with reality; 2013; Langen, N., Adenaeuer, L.
- Research staff and public engagement: a UK study; 2013; Davies, S.
- The challenge of a mixed-mode design survey and new IT tools application: the case of the Italian Structure...; 2013; Cardinaleschi, S., De Santis, S., Rocci, F., Spinelli, V.
- Internet as a new source of information for the production of official statistics. Experiences of Statistics...; 2013; Heerschap, N.
- Assessing Nonresponse Bias in the Green Technologies and Practices Survey; 2013; Meekins, B., Sverchkov, M., Stang, S.
- Using an Item Response Theory Approach to Measure Survey Mode of Administration Effects: Analysis of...; 2013; Mariano, L. T., Elliott, M. N.
- The Role of Mode Preference Questions in Predicting Mode-Specific Response Propensities; 2013; Lynn, P., Kaminska, O.
- Model-Based Mode of Data Collection Switching from Internet to Mail in the American Community Survey; 2013; Chesnut, J.
- Leveraging mobile and online qualitative to get inside shoppers’ heads; 2013; Bryson, J., Ritzo, J.
- An evaluation of mixed methods (diaries and focus groups) when working with older people; 2013; Koopman-Boyden, P., Richardson, M.
- Enhancing student engagement in student experience surveys: a mixed methods study; 2013; Webber, M., Lynch, S., Oluku, J.
- Panel Conditioning in Difficult Attitudinal Questions; 2013; Binswanger, J., Schunk, D., Toepoel, V.
- Web Coverage in the UK and its Potential Impact on General Population Web Surveys; 2013; Callegaro, M.
- A Comparison of Data Quality Across Modes in a Mixed-Mode Collection of Administrative Records; 2013; Worthy, M., Mayclin, D.
- Can Online Surveys Substitute Traditional Modes? An Error-Based Comparison of Online and On-Site Tourism...; 2013; Kim, N., Yu, X., Schwartz, Z.
- Web-Based Versus Traditional Paper Questionnaires: A Mixed-Mode Survey With a Nordic Perspective; 2013; Hohwue, L., Lyshol, H., Gissler, M., Hrafn Jonsson, S., Petzold, M., Obel, C.
- Going online with a face-to-face household panel: initial results from an experiment on the Understanding...; 2013; Jaeckle, A., Lynn, P., Burton, J.
- Developing a New Mixed-Mode Methodology For a Provincial Park Camper Survey in British Columbia; 2013; Dyck, B. W.
- Mode effect analysis and adjustment in a split-sample mixed-mode Web/CATI survey; 2013; Kolenikov, S., Kennedy, C.
- Exploring factors associated with respondent mode choice for surveys using mobile devices.; 2013; Walton, L.
- Responsive design for mixed-mode panel data; 2013; Bianchi, A., Biffignandi, S.
- Adjusting for bias in a mixed-mode CAWI survey on University students ; 2013; Clerici, R., Giraldo, A.
- Insights into Action Profiling shopping occasions for retailers through mobile and online research; 2013; Churkina, O., Morris, T.
- Mobilizing your Branded Panel: Panel data quality during the smartphone transition; 2013; Kugel, C., Brien, D., Blechman, J.
- Specific mixed-mode methodologies to include sensory disabled people in quantitative surveys; 2013; Sebastien, F., Marc, J., Patrick, I.
- An imputation approach for analyzing mixed-mode surveys; 2013; Kim, J. K., Park, S., Kim, S. Y.
- Investigating the Bias of Alternative Statistical Inference Methods in Sequential Mixed-Mode Surveys; 2013; Suzer-Gurtekin, Z., Heeringa, S. G., Valliant, R. L.
- Random versus Systematic Error in a Mixed Mode Online-Telephone Survey; 2013; Hox, J., Scherpenzeel, A., Boeve, A., Boeve, A., de Leeuw, E. D.
- Impact of mode design on reliability in longitudinal data; 2013; Cernat, A.
- Online Survey Participation via Mobile Devices: implications for nonresponse; 2013; Poggio, T., Bosnjak, M.
- Mobility and Smartphones: a pilot study of travel data collection among experienced and inexperienced...; 2013; Douhou, S., Scherpenzeel, A.
- Mobile devices a way to recruit hard-to-reach groups? Results from a pilot study comparing desk top...; 2013; Toepoel, V., Lugtig, P. J.
- Exploring patterns of academic usage: A Google Scholar based study of ESS, EVS, WVS and ISSP academic...; 2013; Malnar, B.
- Web questionnaires in official population surveys: Do's and don'ts First experiments and impacts...; 2013; Blanke, K.
- Mode effects in Labour Force Surveys - do they really matter?; 2013; Koerner, T.
- Effects of Sponsorship on Response: Mixed-Mode Web and Mail Surveying ; 2013; Edwards, M. L., Dillman, D. A., Smyth, J.
- Comparison of quality of web survey and CATI data using unobtrusive response latencies; 2013; Mayerl, J.
- A walking exercise on a tightrope: trying to balance coverage, probabilistic sampling and the costs...; 2013; Poggio, T.
- Data Collection Method Comparisons for the 2011 Fishing, Hunting, and Wildlife-Associated Recreation...; 2013; Herbstritt, M., Hornick, D.
- Trends in Dutch egalitarian attitudes, 1975-2010: An age-period-cohort analysis; 2013; Meuleman, B., Oorschot, W. V.
- Comparing Questionnaire Pretesting Methods for the 2015 Population and Housing Census of Korea; 2013; Park, Y.
- Evaluating the middle category in the left-right self-placement question: Category Selection Probing...; 2013; Hufken, V., Rottinghaus, B.
- Mixed Methods in Cognitive Interviewing: An analysis of the Russian version of the Schwartz Value Survey...; 2013; Efremova, M., Panyusheva, T.
- A mixed methods approach to investigate how Cognitive Interviewing findings can improve the validity...; 2013; Padilla, J. L., Miller, K., Loeb, M.
- Exploring the results of pre-testing questions developed for the European Social Survey: Comparing...; 2013; Widdop, S.
- Validity of Measuring Educational Attainment - Education and Value Orientation in the European Values...; 2013; Ortmanns, V.
- The comparability of Don't Know answers between CATI and CAWI modes; 2013; Pohjanpaa, K., Jarvensivu, M.