The Library
The average laboratory samples a population of 7,300 Amazon Mechanical Turk workers
Tools
Stewart, Neil, Ungemach, Christoph, Harris, Adam J. L. , Bartels, Daniel M., Newell, Benjamin R., Paolacci, Gabriele and Chandler, Jesse (2015) The average laboratory samples a population of 7,300 Amazon Mechanical Turk workers. Judgment and Decision Making, 10 (5). pp. 479-491. ISSN 1930-2975.
|
PDF
WRAP_9771026-ps-040815-stewart_ungemach_harris_bartels_newell_paolacci_chander_in_press.pdf - Published Version - Requires a PDF viewer. Available under License Creative Commons Attribution. Download (1124Kb) | Preview |
Official URL: http://journal.sjdm.org/vol10.5.html
Abstract
Using capture-recapture analysis we estimate the effective size of the active Amazon Mechanical Turk (MTurk) population that a typical laboratory can access to be about 7,300 workers. We also estimate that the time taken for half of the workers to leave the MTurk pool and be replaced is about 7 months. Each laboratory has its own population pool which overlaps, often extensively, with the hundreds of other laboratories using MTurk. Our estimate is based on a sample of 114,460 completed sessions from 33,408 unique participants and 689 sessions across seven laboratories in the US, Europe, and Australia from January 2012 to March 2015.
Item Type: | Journal Article | ||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Subjects: | Q Science > QA Mathematics > QA76 Electronic computers. Computer science. Computer software | ||||||||||||
Divisions: | Faculty of Science, Engineering and Medicine > Science > Psychology | ||||||||||||
Library of Congress Subject Headings (LCSH): | Human computation, Business enterprises -- Computer networks, Population forecasting, Human-computer interaction, Internet marketing | ||||||||||||
Journal or Publication Title: | Judgment and Decision Making | ||||||||||||
Publisher: | Society for Judgment and Decision Making | ||||||||||||
ISSN: | 1930-2975 | ||||||||||||
Official Date: | September 2015 | ||||||||||||
Dates: |
|
||||||||||||
Volume: | 10 | ||||||||||||
Number: | 5 | ||||||||||||
Page Range: | pp. 479-491 | ||||||||||||
Status: | Peer Reviewed | ||||||||||||
Publication Status: | Published | ||||||||||||
Access rights to Published version: | Open Access (Creative Commons) | ||||||||||||
Date of first compliant deposit: | 30 December 2015 | ||||||||||||
Date of first compliant Open Access: | 30 December 2015 | ||||||||||||
RIOXX Funder/Project Grant: |
|
||||||||||||
Related URLs: |
Request changes or add full text files to a record
Repository staff actions (login required)
View Item |
Downloads
Downloads per month over past year