Towards a Leaner Evaluation Process: Application to Error Correction Systems
| Autor: | Arnaud Renard, Sylvie Calabretto, Béatrice Rumpler |
|---|---|
| Přispěvatelé: | Distribution, Recherche d'Information et Mobilité (DRIM), Laboratoire d'InfoRmatique en Image et Systèmes d'information (LIRIS), Institut National des Sciences Appliquées de Lyon (INSA Lyon), Université de Lyon-Institut National des Sciences Appliquées (INSA)-Université de Lyon-Institut National des Sciences Appliquées (INSA)-Centre National de la Recherche Scientifique (CNRS)-Université Claude Bernard Lyon 1 (UCBL), Université de Lyon-École Centrale de Lyon (ECL), Université de Lyon-Université Lumière - Lyon 2 (UL2)-Institut National des Sciences Appliquées de Lyon (INSA Lyon), Université de Lyon-Université Lumière - Lyon 2 (UL2), SI LIRIS, Équipe gestionnaire des publications |
| Jazyk: | angličtina |
| Rok vydání: | 2013 |
| Předmět: |
business.industry
Computer science Process (engineering) Context (language use) 02 engineering and technology Modular design [INFO] Computer Science [cs] Machine learning computer.software_genre Set (abstract data type) Core (game theory) 020204 information systems 0202 electrical engineering electronic engineering information engineering 020201 artificial intelligence & image processing [INFO]Computer Science [cs] Artificial intelligence State (computer science) business Error detection and correction computer |
| Zdroj: | Lecture Notes in Business Information Processing (LNBIP) Lecture Notes in Business Information Processing (LNBIP), Springer-Verlag, 2013 Enterprise Information Systems ISBN: 9783642406539 ICEIS |
| Popis: | International audience; While they follow similar procedures, evaluations of state of the art error correction systems always rely on different resources (collections of documents, evaluation metrics, dictionaries, ...). In this context, error correction approaches cannot be directly compared without being re-implemented from scratch every time they have to be compared with a new one. In other domains such as Information Retrieval this problem is solved through Cranfield like experiments such as TREC evaluation campaign. We propose a generic solution to overcome those evaluation difficulties through a modular evaluation platform which formalizes similarities between evaluation procedures and provides standard sets of instantiated resources for particular domains. While this was our main problem at first, in this article, the set of resources is dedicated to the evaluation of error correction systems. The idea is to provide the leanest way to evaluate error correction systems by implementing only the core algorithm and relying on the platform for everything else. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|