Panlingual lexical translation via probabilistic inference
| Autor: | null Mausam, Stephen Soderland, Oren Etzioni, Daniel S. Weld, Kobi Reiter, Michael Skinner, Marcus Sammer, Jeff Bilmes |
|---|---|
| Rok vydání: | 2010 |
| Předmět: |
Linguistics and Language
Computer science business.industry Transitive inference Inference Probabilistic inference computer.software_genre Lexical translation Language and Linguistics Rule-based machine translation Multilinguality Artificial Intelligence Graph (abstract data type) Pairwise comparison Compiler Artificial intelligence Precision and recall business computer Natural language processing |
| Zdroj: | Artificial Intelligence. 174(9-10):619-637 |
| ISSN: | 0004-3702 |
| DOI: | 10.1016/j.artint.2010.04.020 |
| Popis: | This paper introduces a novel approach to the task of lexical translation between languages for which no translation dictionaries are available. We build a massive translation graph, automatically constructed from over 630 machine-readable dictionaries and Wiktionaries. In this graph each node denotes a word in some language and each edge (vi,vj) denotes a word sense shared by vi and vj. Our current graph contains over 10,000,000 nodes and expresses more than 60,000,000 pairwise translations.The composition of multiple translation dictionaries leads to a transitive inference problem: if word A translates to word B which in turn translates to word C, what is the probability that C is a translation of A? The paper describes a series of probabilistic inference algorithms that solve this problem at varying precision and recall levels. All algorithms enable us to quantify our confidence in a translation derived from the graph, and thus trade precision for recall.We compile the results of our best inference algorithm to yield PanDictionary, a novel multilingual dictionary. PanDictionary contains more than four times as many translations as in the largest Wiktionary at precision 0.90 and over 200,000,000 pairwise translations in over 200,000 language pairs at precision 0.8. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|
Full Text from ScienceDirect