Web Survey Bibliography
The use of anchoring vignettes to correct for differential item functioning rests upon two identifying assumptions: vignette equivalence and response consistency. To test the second assumption the authors conduct an experiment in which respondents in an Internet panel are asked to both describe their health in a number of domains and rate their health in these domains. In a subsequent interview respondents are shown vignettes that are in fact descriptions of their own health. Under response consistency and some auxiliary assumptions with regard to the validity of the experiment, there should be no systematic differences between the evaluation of these vignettes in the second interview and the self-evaluations in the first interview. They analyze data for five health domains: sleep, mobility, concentration, breathing and affect. Although descriptively the vignettes and the self-evaluations are similar for a number of domains, their nonparametric analysis suggests that response consistency is satisfied for the domain of sleep, while it indicates rejection of either the auxiliary assumptions or response consistency for the other domains of health. Parametric analysis suggests that the auxiliary assumptions may be most problematic. The analysis points at the need for a systematic experimental approach to the design of anchoring vignettes before using them in practice.
RAND Corporation Homepage (abstract) / (full text)
Web Survey Bibliography - Kapteyn, A. (13)
- Conducting Respondent Driven Sampling on the Web: An Experimental Approach to Recruiting Challenges; 2011; Kapteyn, A., Schonlau, M.
- Anchoring vignettes: response consistency and order effects; 2011; Kapteyn, A., Smith, J. P., van Soest, A., Vonkova, H.
- Framing Effects and Expected Social Security Claiming Behavior; 2011; Brown, J., Kapteyn, A., Mitchell, O. S.
- Mode and Context Effects in Measuring Household Assets; 2010; van Soest, A., Kapteyn, A.
- Selection Bias in Web Surveys and the Use of Propensity Scores; 2009; Schonlau, M., van Soest, A., Kapteyn, A., Couper, M. P.
- Beyond Demographics: Are ‘Webographic’ Questions Useful for Reducing the Selection Bias...; 2007; Schonlau, M., van Soest, A., Kapteyn, A.
- The Quality of Subjective Probability Data in the HRS: CAPI, CATI, and Internet Interviews; 2007; Dominitz, J., Hurd, M. D., Kapteyn, A.
- Are ‘Webographic' or Attitudinal Questions Useful for Adjusting Estimates from Web Surveys Using...; 2007; Schonlau, M., van Soest, A., Kapteyn, A.
- Noncoverage and nonresponse in an Internet survey; 2007; Kapteyn, A., Schonlau, M., Couper, M. P.
- Selection Bias in Web Surveys and the Use of Propensity Scores; 2006; Schonlau, M., van Soest, A., Kapteyn, A., Couper, M. P.
- Adjusting for selection bias in Web surveys using propensity scores: the case of the Health and Retirement...; 2005; Schonlau, M., van Soest, A., Kapteyn, A., Couper, M. P.
- Attempting to adjust for selection bias in Web surveys with propensity scores: the case of the Health...; 2004; Schonlau, M., van Soest, A., Kapteyn, A., Couper, M. P., Winter, J.
- Noncoverage and Nonresponse in a Web Survey; 2004; Couper, M. P., Kapteyn, A., Schonlau, M., Winter, J.