The Library
Crowdsourcing complex workflows under budget constraints
Tools
Tran-Thanh, Long, Huynh, Trung Dong, Rosenfeld, Avi, Ramchurn, Sarvapali D. and Jennings, Nicholas R. (2015) Crowdsourcing complex workflows under budget constraints. In: The Twenty-Ninth AAAI Conference on Artificial Intelligence (AAAI-15), Austin, Texas, 25-29 Jan 2015. Published in: AAAI'15: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence pp. 1298-1304. ISBN 0262511290.
|
PDF
WRAP-crowdsourcing-complex-workflows-under-budget-constraints-Tran-Thanh-2020.pdf - Accepted Version - Requires a PDF viewer. Download (1280Kb) | Preview |
Official URL: https://dl.acm.org/doi/10.5555/2887007.2887187
Abstract
We consider the problem of task allocation in crowdsourcing systems with multiple complex workflows, each of which consists of a set of inter-dependent micro-tasks. We propose Budgeteer, an algorithm to solve this problem under a budget constraint. In particular, our algorithm first calculates an efficient way to allocate budget to each workflow. It then determines the number of inter-dependent micro-tasks and the price to pay for each task within each workflow, given the corresponding budget constraints. We empirically evaluate it on a well-known crowdsourcing-based text correction workflow using Amazon Mechanical Turk, and show that Budgeteer can achieve similar levels of accuracy to current benchmarks, but is on average 45% cheaper.
Item Type: | Conference Item (Paper) | ||||||
---|---|---|---|---|---|---|---|
Subjects: | Q Science > QA Mathematics > QA76 Electronic computers. Computer science. Computer software | ||||||
Divisions: | Faculty of Science, Engineering and Medicine > Science > Computer Science | ||||||
Library of Congress Subject Headings (LCSH): | Crowdsourcing, Workflow -- Management -- Computer programs, Business -- Data processing -- Management, Management information systems, Budget -- Mathematical models | ||||||
Journal or Publication Title: | AAAI'15: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence | ||||||
Publisher: | AAAI Press | ||||||
ISBN: | 0262511290 | ||||||
Official Date: | 25 January 2015 | ||||||
Dates: |
|
||||||
Page Range: | pp. 1298-1304 | ||||||
Status: | Peer Reviewed | ||||||
Publication Status: | Published | ||||||
Access rights to Published version: | Restricted or Subscription Access | ||||||
Date of first compliant deposit: | 22 July 2020 | ||||||
Date of first compliant Open Access: | 22 July 2020 | ||||||
RIOXX Funder/Project Grant: |
|
||||||
Conference Paper Type: | Paper | ||||||
Title of Event: | The Twenty-Ninth AAAI Conference on Artificial Intelligence (AAAI-15) | ||||||
Type of Event: | Conference | ||||||
Location of Event: | Austin, Texas | ||||||
Date(s) of Event: | 25-29 Jan 2015 | ||||||
Related URLs: |
Request changes or add full text files to a record
Repository staff actions (login required)
View Item |
Downloads
Downloads per month over past year