Web Survey Bibliography
A core tenet of survey research is that the inferences one makes about the population can only be as good as the quality of the respondents in the sample. However, with declines in probability sample response rates and increases in non-probability Internet-based research, researchers have found it increasingly difficult to agree on the quality of a survey sample. Contributing to this difficulty is the variety of research studies that have evaluated the quality of survey data derived from probability-based and non-probability-based sources and the effectiveness of statistical methods to reduce error in data from
these sources. Specifically, some research has documented a greater average error among non-probability samples relative to probability samples (Chang & Krosnick, 2009; Yeager et al., in press), while other research has found few or small differences between the two. Other research has pointed to greater variability in results from surveys non-probability samples of Internet volunteers. For instance, Dedeker (2006) conducted the same study twice on the same Internet survey panel and reached two different business conclusions. An additional study found five to ten times greater variability in error among a sample of seven Internet surveys of non-probability samples versus seven probability sample surveys (Yeager et al., in press). Similarly-sized variability was found in the National Dutch Online Panel Comparison Study. Relatedly, statistical methods such as post-stratification survey weighting have inconsistent effects on non-probability sample surveys, and in some cases increase survey error. It is critically important to synthesize the survey accuracy studies summarized above as well as others. The present study will evaluate the evidence from more than 45 different studies have assessed the accuracy of non-probability sample surveys and the effectiveness of methods to improve their accuracy,
with the aim of helping researchers and consumers to have more informed expectations about data quality in their surveys.
Conference Homepage (abstract)
Web Survey Bibliography - Krosnick, J. A. (56)
- Can Official Records Correct Errors in Turnout Self-reports?; 2012; Berent, M., Krosnick, J. A., Lupia, A.
- Improving Question Design to Maximize Reliability and Validity; 2012; Krosnick, J. A.
- How accurate are surveys of objective phenomena?; 2012; Chang, L. C., Krosnick, J. A.
- Does mentioning "Some People" and "Other People" in an opinion question improve...; 2012; Yeager, D. S., Krosnick, J. A.
- What Number of Scale Points in an Attitude Question Optimizes Response Validity and Administration Practicality...; 2012; Yeager, D. S., Anand, S., Krosnick, J. A.
- A Systematic Review of Studies Investigating the Quality of Data Obtained with Online Panels; 2012; Callegaro, M., Villar, A., Krosnick, J. A., Yeager, D. S.
- Measuring americans' issue priorities. A new version of the most important problem question reveals...; 2011; Yeager, D. S., Larson, S. B., Krosnick, J. A., Tompson, T.
- Experiments for evaluating survey questions; 2011; Krosnick, J. A.
- Does mentioning "some people" and "other people" in a survey question increase the...; 2011; Yeager, D. S., Krosnick, J. A.
- Comparing the Accuracy of RDD Telephone Surveys and Internet Surveys Conducted with Probability and...; 2011; Yeager, D. S., Krosnick, J. A., Chang, L. C., Javitz, H. S., Levendusky, M. S., Simpser, A., Wang, R...
- More comparisons of Probability and Non-Probability Sample Internet Surveys: The Dutch NOPVO Study.; 2011; Weiss, R., Krosnick, J. A., Yeager, D. S.
- Measuring User Satisfaction in the Lab: Questionnaire Mode, Physical Location, and Social Presence Concerns...; 2011; Jans, M., Romano, J. C., Ashenfelter, K. T., Krosnick, J. A.
- Comparing the Accuracy of RDD Telephone Surveys and Internet Surveys Conducted with Probability and...; 2011; Yeager, D. S., Krosnick, J. A., Chang, L. C., Javitz, H. S., Levindusky, M. S., Simpser, A.; Wang, R...
- Assessing the Accuracy of the Face-to-Face Recruited Internet Survey Platform: A Comparison of Behavioral...; 2010; Villar, A., Malka, A., Krosnick, J. A.
- Study of Non-Probability Sample Internet Surveys' Estimates of Consumer Product Usage and Demographic...; 2010; Yeager, D. S., Carter, A., Tewoldemedhin, H., Krosnick, J. A.
- Computing weights for the American National Election Study survey data; 2009; Debell, M., Krosnick, J. A.
- Question and Questionnaire Design; 2009; Krosnick, J. A., Presser, S.
- Dispositions and Outcome Rates in the “Face-to- Face/Internet Survey Platform" (the FFISP); 2009; Sakshaug, J. W., Tourangeau, K., Krosnick, J. A., Ackermann, A., Malka, A., Debell, M., Turakhia, C.
- Attrition in a Face-to-Face Recruited Internet Panel with Substantial Incentives; 2009; Malka, A., Krosnick, J. A., Ackermann, A., Debell, M., Turakhia, C.
- Lessons Learned About How to Accomplish Effective In- Person Recruitment of a Web-Equipped Survey Panel...; 2009; Ackermann, A., Krosnick, J. A., Turakhia, C., Debell, M., Malka, A., Jarmon, R.
- Comparison Study of Probability and Non-Probability Sample Surveys Conducted by Internet and Face to...; 2009; Yeager, D. S., Krosnick, J. A.
- Does Weighting Improve the Accuracy of Data from Non- Probability Internet Survey Panels of People Who...; 2009; Yeager, D. S., Krosnick, J. A.
- National Surveys Via RDD Telephone Interviewing vs. the Internet: Comparing Sample Representativeness...; 2009; Chang, L. C., Krosnick, J. A.
- Lottery Style Incentives and Response Rates to Online Surveys; 2009; Pearson, J., E., Krosnick, J. A.Levine, R. E.
- Scientific Survey Research: Sustainable in an Online World?; 2009; Krosnick, J. A.
- Money for Surveys: What about Data-Quality?; 2009; A.Krosnick, J. A.
- Optimal Design of Branching Questions to Measure Bipolar Constructs; 2009; Malhotra, N., Krosnick, J. A., Thomas, R. K.
- National Surveys Via RDD Telephone Interviewing vs. the Internet: Comparing Sample Representativeness...; 2008; Chang, L. C., Krosnick, J. A.
- The accuracy of online surveys with non-probability samples; 2008; Krosnick, J. A.
- ‘For Example’: How Different Example Types in Online Surveys Influence Frequency ; 2008; Berent, M., Krosnick, J. A.
- Comparing the Results of Probability and Non-probability Telephone and Internet Survey Data; 2008; Wang, R., Krosnick, J. A.
- “For Example…,” How Different Example Types in Online Surveys Influence Frequency...; 2008; Berent, M., Krosnick, J. A.
- Response option ordering: Reconciliating meanings conveyed by rating scale position and label. Unpublished...; 2007; Garland, P., Krosnick, J. A.
- The Effect of Survey Mode and Sampling on Inferences about Political Attitudes and Behavior: Comparing...; 2007; Malhotra, N., Krosnick, J. A.
- Face-to-Face Recruitment of an Internet Survey Panel: Lessons from an NSF-Sponsored Demonstration Protect...; 2007; O'Muircheartaigh, C., Krosnick, J. A., Dennis, J. M.
- The Effect of Survey Mode and Sampling on Inferences about Political Attitudes and Behavior: Comparing...; 2007; Malhotra, N., Krosnick, J. A.
- The measurement of attitudes; 2005; Krosnick, J. A., Judd, C. M., Wittenbrink, B.
- Comparing the results of probability and non-probability sample surveys; 2005; Krosnick, J. A.
- Effects of survey data collection mode on response quality: Implications for mixing modes in cross-national...; 2005; Krosnick, J. A.
- Vote Over-Reporting: Testing the Social Desirability Hypothesis in Telephone and Internet Surveys; 2005; Holbrook, A. L., Krosnick, J. A.
- Effect of Respondent Motivation and Tack Difficulty on Nondifferentiation in Ratings: A Test of Satisficing...; 2005; Anand, S., Krosnick, J. A., Mulligan, K., Smith, W., Green, M. C., Bizer, G. Y.
- Comparing Major Survey Firms in Terms of Survey Satisficing: Telephone and Internet Data Collection; 2005; Krosnick, J. A., Nie, N., Rivers, D.
- Web Survey Methodologies: A Comparison of Survey Accuracy; 2005; Krosnick, J. A., Nie, N., Rivers, D.
- Comparing Data Quality in Telephone and Internet Surveys: Results of Lab and Field Experiments; 2003; Krosnick, J. A.
- Can What We Don’t Know (about “Don’t Know”) Hurt Us?: Effects of Item Non-response...; 2003; Krosnick, J. A., Behnke, C. S., Lafond, C.R., Thomas, R. K.
- How Does Ranking Rate?: A Comparison of Ranking and Rating Tasks.; 2003; Krosnick, J. A., Shaeffer, E. M., Thomas, R. K.
- Comparing Self-administered Computer Surveys and Auditory Interviews: An Experiment; 2002; Chang, L. C., Krosnick, J. A.
- More Is Not Necessarily Better: Effects of Response Categories on Measurement Stability and Validity; 2002; Thomas, R. K., Uldall, B. R., Krosnick, J. A.
- Reliability and Validity of Web-based Surveys: Effects of Response Modality, Item Format, and Number...; 2002; Uldall, B. R., Thomas, R. K., Krosnick, J. A.
- A Comparison of the Random Digit Dialing Telephone Survey Methodology with Internet Survey Methodology...; 2001; Chang, L. C., Krosnick, J. A.