Overview of the WiQA task at CLEF 2006
| Autor: | Jijkoun, V., de Rijke, M., Peters, C., Clough, P., Gey, F.C., Karlgren, J., Magnini, B., Oard, D.W., Stempfhuber, M. |
|---|---|
| Přispěvatelé: | Information and Language Processing Syst (IVI, FNWI) |
| Jazyk: | angličtina |
| Rok vydání: | 2007 |
| Předmět: |
Information retrieval
Repetition (rhetorical device) Computer science business.industry Factoid InformationSystems_INFORMATIONSTORAGEANDRETRIEVAL computer.software_genre Clef Task (project management) Working note Question answering Mean reciprocal rank Artificial intelligence business computer Natural language processing |
| Zdroj: | Evaluation of Multilingual and Multi-modal Information Retrieval: 7th Workshop of the Cross-Language Evaluation Forum, CLEF 2006, Alicante, Spain, September 20-22, 2006 : revised selected papers, 265-274 STARTPAGE=265;ENDPAGE=274;TITLE=Evaluation of Multilingual and Multi-modal Information Retrieval Evaluation of Multilingual and Multi-modal Information Retrieval ISBN: 9783540749981 CLEF |
| Popis: | We describe WiQA 2006, a pilot task aimed at studying question answering using Wikipedia. Going beyond traditional factoid questions, the task considered at WiQA 2006 was to return—given an source page from Wikipedia—to identify snippets from other Wikipedia pages, possibly in languages different from the language of the source page, that add new and important information to the source page, and that do so without repetition.A total of 7 teams took part, submitting 20 runs. Our main findings are two-fold: (i) while challenging, the tasks considered at WiQA are do-able as participants achieved impressive scores as measured in terms of yield, mean reciprocal rank, and precision, (ii) on the bilingual task, substantially higher scores were achieved than on the monolingual tasks. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|