Web Survey Bibliography
Title Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk
Author Berinsky, A.; Huber, G. A.; Lenz, G. S.
Source Political Analysis
Year 2016
Access date 04.04.2016
Abstract We examine the trade-offs associated with using Amazon.com’s Mechanical Turk (MTurk) interface for subject recruitment. We first describe MTurk and its promise as a vehicle for performing low-cost and easy-to-field experiments. We then assess the internal and external validity of experiments performed using MTurk, employing a framework that can be used to evaluate other subject pools. We first investigate the characteristics of samples drawn from the MTurk population. We show that respondents recruited in this manner are often more representative of the U.S. population than in-person convenience samples—the modal sample in published experimental political science—but less representative than subjects in Internet-based panels or national probability samples. Finally, we replicate important published experimental work using MTurk samples.
Access/Direct link Journal Homepage (Abstract) / (Full text)
Year of publication2012
Bibliographic typeJournal article
Web survey bibliography - Political Analysis (7)
- Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk; 2016; Berinsky, A.; Huber, G. A.; Lenz, G. S.
- Online Polls and Registration-Based Sampling: A New Method for Pre-Election Polling; 2014; Barber, M. J., Mann, C. B., Monson, J. Q., Patterson, K. D.
- Does Survey Mode Still Matter? Findings from a 2010 Multi-Mode Comparison; 2014; Ansolabehere, S., Schaffner, B. F.
- Nonresponse and Mode Effects in Self- and Interviewer-Administered Surveys; 2014; Atkeson, L. R.; Adams, A. N.; Alvarez, M. R.
- Does mode matter for modeling political choice? Evidence from the 2005 British Election Study; 2007; Sanders, D., Clarke, H. D., Stewart, M. C., Whiteley, P.
- Response latency methodology for survey research: Measurement and modeling strategies; 2003; Mulligan, K., T., Mockabee, S. T., Grant, J. T., Monson, J. Q.
- The Advent of internet surveys for political research: a comparison of telephone and internet surveys...; 2003; Berrens, R. P., Bohara, A. K., Jenkins-Smith, H. C., Silva, C. L., Weimer, D. L.