Prospect Theory Based Crowdsourcing for Classification in the Presence of Spammers
| Autor: | Baocheng Geng, Qunwei Li, Pramod K. Varshney |
|---|---|
| Rok vydání: | 2020 |
| Předmět: |
FOS: Computer and information sciences
Value (ethics) Computer Science - Machine Learning Majority rule Computer science media_common.quotation_subject Computer Science - Human-Computer Interaction Machine Learning (stat.ML) Rationality 02 engineering and technology Crowdsourcing Machine learning computer.software_genre Human-Computer Interaction (cs.HC) Machine Learning (cs.LG) Statistics - Machine Learning Prospect theory 0202 electrical engineering electronic engineering information engineering Electrical and Electronic Engineering media_common business.industry 020206 networking & telecommunications Decision rule Payment Signal Processing Artificial intelligence business computer |
| Zdroj: | IEEE Transactions on Signal Processing. 68:4083-4093 |
| ISSN: | 1941-0476 1053-587X |
| Popis: | We consider the $M$-ary classification problem via crowdsourcing, where crowd workers respond to simple binary questions and the answers are aggregated via decision fusion. The workers have a reject option to skip answering a question when they do not have the expertise, or when the confidence of answering that question correctly is low. We further consider that there are spammers in the crowd who respond to the questions with random guesses. Under the payment mechanism that encourages the reject option, we study the behavior of honest workers and spammers, whose objectives are to maximize their monetary rewards. To accurately characterize human behavioral aspects, we employ prospect theory to model the rationality of the crowd workers, whose perception of costs and probabilities are distorted based on some value and weight functions, respectively. Moreover, we estimate the number of spammers and employ a weighted majority voting decision rule, where we assign an optimal weight for every worker to maximize the system performance. The probability of correct classification and asymptotic system performance are derived. We also provide simulation results to demonstrate the effectiveness of our approach. Comment: 14 pages, 6 figures |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|