Web Survey Bibliography
Title Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk
Author Berinsky, A.; Huber, G. A.; Lenz, G. S.
Source Political Analysis
Year 2016
Access date 04.04.2016
Abstract We examine the trade-offs associated with using Amazon.com’s Mechanical Turk (MTurk) interface for subject recruitment. We first describe MTurk and its promise as a vehicle for performing low-cost and easy-to-field experiments. We then assess the internal and external validity of experiments performed using MTurk, employing a framework that can be used to evaluate other subject pools. We first investigate the characteristics of samples drawn from the MTurk population. We show that respondents recruited in this manner are often more representative of the U.S. population than in-person convenience samples—the modal sample in published experimental political science—but less representative than subjects in Internet-based panels or national probability samples. Finally, we replicate important published experimental work using MTurk samples.
Access/Direct link Journal Homepage (Abstract) / (Full text)
Year of publication2012
Bibliographic typeJournal article
Web survey bibliography - 2012 (371)
- Assessment of Innovations in Data Collection Technology for Understanding Society; 2016; Couper, M. P.
- Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk; 2016; Berinsky, A.; Huber, G. A.; Lenz, G. S.
- A Technical Guide to Effective and Accessible web Surveys; 2016; Baatard, G.
- 28 Questions to Help Buyers of Online Samples; 2015; Cape, P. J.; Phillips, A.; Baker, R.; Cooke, M.; Ribeiro, E.; Terhanian, G.
- Ethical decision-making and Internet research 2.0: Recommendations from the AoIR ethics working committee...; 2015; Markham, A.; Buchanan, E. A.
- Internet-Mediated Technologies and Mixed Methods Research; Problems and Prospects; 2012; Hesse-Biber, S.; Griffin, A. J.
- An Evaluation of Internet Versus Paper-based Methods for Public Participation Geographic Information...; 2012; Pocewicz, A.; Nielsen-Pincus, M.; Brown, G.; Schnitzer, R.
- Counting and Measuring Online: The Quality of Internet Surveys; 2012; De Leeuw, E. D.
- The who, when, where and how of Smartphone research; 2012; Fine, B., Menictas, C.
- Likert Scales vs. Slider Scales in commercial market research; 2012; Dobronte, A.
- Clustering of Categorical Data by Assigning Rank through Statistical Approach; 2012; Patnaik, S. K., Sahoo, S., Swain, D. K.
- Web CATI (Part of NatCen’s Multi-Mode Approach) ; 2012; Damestani, P., Agur, M.
- Code Comparison; 2012
- Design of Web Questionnaires: Matrix Questions or Single Question Formats ; 2012; de Leeuw, E. D., Hox, J., Klausch, L. T., Roberts, A., de Jongh, A.
- A World Wide Web–based survey of nonmedical tattooing in the United States ; 2012; Karagas, M. R., Wasson, J. H.
- Web-based data collection yielded an additional response bias—but had no direct effect on outcome...; 2012; Mayr, A., Gefeller, O., Prokosch, H.-U., Pirkl, A., Froehlich, A. de Zwaan, M.
- Web-based studies: The future in nutritional epidemiology (and overarching epidemiology) for the benefit...; 2012; Hercberg, S.
- Medical students’ exposure to Urology in the undergraduate curriculum, a web based survey; 2012; Derbyshire, L. F., O’Flynn, K. J.
- Evidence-Based Treatment Methods for the Management of Shoulder Impingement Syndrome Among Dutch-Speaking...; 2012; Struyf, F., Nijs, J., Gulinck, J., De Hertogh, W.
- Irrigation Trends among American Association of Endodontists Members: A Web-based Survey; 2012; Dutner, J., Anderson, A., Mines, P.
- Assessment and management of dysphagia in patients with head and neck cancer who receive radiotherapy...; 2012; Roe, J. W. G., Carding, P. N., Rhys-Evans, P. H., Newbold, K. L., Nutting, C. M., Harrington, K. J.
- Training fellows for retinopathy of prematurity care: A Web-based survey; 2012; Espiritu, M. J., Henchoz, L., Ventura, C. V.; K., Yonekawa, Y., Chiang, M. F.; K., Lee, T. C.; K.,...
- Progesterone support in IVF: is evidence-based medicine translated to clinical practice? A worldwide...; 2012; Vaisbuch, E., Leong, M., Shoham, Z.
- Increasing Response Rates to Web-Based Surveys; 2012; Monroe, M. C., Adams, D. C.
- Library Use of Web-based Research Guides; 2012; Ghaphery, J., White, E.
- A Comparison of Results from Surveys by the Pew Research Center and Google Consumer Surveys; 2012; Keeter, S., Christian, L. M.
- Sensitive topics in PC Web and mobile web surveys: Is there a difference? (presentation); 2012; Mavletova, A. M., Couper, M. P.
- Identifying Careless Responses in Survey Data; 2012; Mead, A. D., Bartholomew, C.
- Presenting Survey Items One at a Time Compared to All at Once Decreases Missing Data without Sacrificing...; 2012; Nosek, B.; Umansky, E.
- Evaluation procedures for Survey questions; 2012; Saris, W. E.
- How to calculate the length of a survey ; 2012; Puleston, J.
- What is Online Research?: Using the Internet for Social Science Research; 2012; Hooley, H., Wellens, J., Marriott, J.
- Which Polls Fared Best (and Worst) in the 2012 Presidential Race; 2012; Silver, N.
- Usability 101: Introduction to Usability; 2012; Nielsen, J.
- The association between online gaming, social phobia, and depression: an internet survey; 2012; Chen, M.-H., Huang, P.-C., Bai, Y.-M., Wei, H.-T.
- An Acceptance Model of Recommender Systems Based on a Large-Scale Internet Survey; 2012; Asoh, H., Ono, C., Habu, Y., Takasaki, H., Takenaka, T., Motomura, Y.
- P02.04. Internet survey confirms strong interest in Yoga among fibromyalgia patients; 2012; Carson, J., Bennett, R., Jones, K., Mist, S.
- Approaches to empiric ablation of slow pathway: results from the Canadian EP web survey; 2012; Laish-Farkash, A., Shurrab, M., Tiong, I., Verma, A., Amit, G., Kiss, A., Morriello, F., Singh, S.,...
- Statistical Disclosure Control; 2012; Hundepool, A., Domingo-Ferrer, J., Franconi, L., Giessing, S., Schulte Nordholt, E., Spicer, K., de...
- Methodology of the RAND Continuous 2012 Presidential Election Poll ; 2012; Kapteyn, A., Meijer, E., Weerman, B.
- How and when social media storms impact brands; 2012; Morris, A., Perry, H.
- (Online) Access Panels: Types and Quality Standards; 2012; Bosnjak, M.
- Biting the Hand and Bending the Rules: An IJMR Presentation; 2012; Pettit, A.
- Passive measurement of online data in Practice - A White Paper Wakoopa; 2012
- Using response probabilities for assessing representativity; 2012; Bethlehem, J.
- Analysis of Web Survey Data based on Similarity of Fuzzy Clusters; 2012; Chiba, R., Sato-Ilic, M.
- Disentangling Mode-Specific Selection and Measurement Bias in Social Surveys; 2012; Buelens, B., van der Laan, J., Schouten, B., Klausch, L. T., van der Brakel, J., Burger, J.
- The efficiency and effectiveness of mixed mode versus single mode designs; 2012; Blunsdon, B.
- The National Survey of College Graduates: Developing a Web Data Collection Component; 2012; Thornton, T.
- Automated Web Testing Using Selenium; 2012; Gaston, D., Fanning, S., Daher, L.