The ActiveCrowdToolkit: an open-source tool for benchmarking active learning algorithms for crowdsourcing research

Autor: Matteo Venanzi, Oliver Parson, Alex Rogers, Nick Jennings
Jazyk: angličtina
Rok vydání: 2015
Popis: We present an open-source toolkit that allows the easy comparison of the performance of active learning methods over a series of datasets. The toolkit allows such strategies to be constructed by combining a judgement aggregation model, task selection method and worker selection method.The toolkit also provides a user interface which allows researchers to gain insight into worker performance and task classification at runtime.
Databáze: OpenAIRE