Web Survey Bibliography
The aim of this chapter is to provide readers with (1) information about the different methods for testing survey questions and (2) guidelines on the implementation of each of the methods. The initial section of the chapter explores why it is essential to test your survey questions. A section that explores the traditional field test follows this. For interview surveys, the traditional field test involves a small number of interviewers doing a few interviews each followed by an interviewer debriefing session with the researcher. For postal surveys this involves posting the questionnaires to respondents and reviewing the questionnaires that are returned. Various decisions that need to be made in this process are reviewed as well as limitations. The third section looks at 6 new additional testing methods. “Expert Reviews/ Panels” make use of expert advice about question problems and a “Systematic Review of Questionnaire” involves comparing each question to a pre-specified checklist of potential problems. “Respondent Debriefing Questions” are special follow-up questions used to determine respondents’ understanding of the original survey question. “Behavior Coding” is the systematic coding of both interviewer and respondent behavior during the interview. “Cognitive Interviewing” is a type of in-depth interview that pays explicit attention to the mental processes respondents use to answer survey questions. The final method is the use of “Focus Groups” for question testing. The last section focuses on a discussion of combining methods into a successful testing plan.
Book Homepage (abstract) / (full text)
Web survey bibliography - Campanelli, P. (9)
- Revisiting “yes/no” versus “check all that apply”: Results from a mixed modes...; 2016; Nicolaas, G.; Campanelli, P.; Hope, S.; Jaeckle, A.; Lynn, P.
- The Use of Cognitive Interviewing Methods to Evaluate Mode Effects in Survey Questions; 2014; Gray, M., Blake, M., Campanelli, P.
- Question or Mode Effects in Mixed-Mode surveys: A Cross-cultural study in the Netherlands, Germany,...; 2012; de Leeuw, E. D., Nicolaas, G., Campanelli, P., Hox, J.
- ISER working paper 2011-31. Is it a good idea to optimise question format for mode of data collection...; 2011; Nicolaas, G., Campanelli, P., Hope, S., Jaeckle, A., Lynn, P.
- The use of cognitive interviewing methods to evaluate mode effects in survey questions; 2011; Gray, M., Blake, M., Campanelli, P., Hope, S.
- Is it a good idea to optimise question format for mode of data collection? Results from a mixed modes...; 2011; Nicolaas, G., Campanelli, P., Hope, S., Lynn, P., Nandi, A.
- Designing questions for mixed mode data collection: What have we learnt so far?; 2010; Nicolaas, G., Campanelli, P.
- Mixed Modes and Measurement Error: Comparing face-to-face, telephone and web modes ; 2009; Hope, S., Nicolaas, G., Jaeckle, A., Lynn, P., Nandi, A., Campanelli, P.
- Testing survey questions; 2008; Campanelli, P.