Object identification with Pay-As-You-Go crowdsourcing
| Autor: | Pan Hui, Siyuan Liu, Chen Jason Zhang, Lei Chen, Ting Wu |
|---|---|
| Rok vydání: | 2016 |
| Předmět: |
business.industry
Computer science Process (engineering) media_common.quotation_subject 05 social sciences 050801 communication & media studies Workload 02 engineering and technology Crowdsourcing Payment Object (computer science) Machine learning computer.software_genre Task (project management) Identification (information) 0508 media and communications 020204 information systems 0202 electrical engineering electronic engineering information engineering Artificial intelligence business computer media_common |
| Zdroj: | IEEE BigData |
| Popis: | The conventional crowdsourcing paradigm requires an explicit task description and payment scheme. Requesters can then easily determine whether the crowdsourced results are satisfactory, and workers will have a fairly clear expectation of the monetary reward once the task is accomplished. However, such a paradigm becomes problematic when it is applied to Object Identification (OI) tasks. First, for OI tasks, it is difficult for requesters to evaluate whether sufficient numbers of objects have been found by an individual worker, warranting payment. Second, the same objects can be detected by many workers and ending up being unnecessary workload and inefficient performance. In this paper, we design a new crowdsourcing paradigm for OI tasks. Designing such a paradigm is challenging. Firstly, an easily-detected object can be found by multiple workers, which leads to an unfair situation that the requester has to make extra payments for the duplication. Secondly, there is usually a time limit to finish the overall crowdsourcing process, which demands efficient assignment strategy. To address these challenges, we propose solutions to achieve fairness by a Pay-As-You-Go (PAYG) mechanism and efficiency by a new worker-assignment scheme, Adaptive Worker Assignment (AWA). Extensive experiments are conducted to demonstrate the advantages of this new paradigm. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|