Figures of merit for assessing connected-word recognisers
| Autor: | Melvyn J. Hunt |
|---|---|
| Rok vydání: | 1990 |
| Předmět: |
Linguistics and Language
Computer science Communication Speech recognition Substitution (logic) Sequence matching Measure (mathematics) Language and Linguistics Total error Computer Science Applications Dynamic programming Modeling and Simulation Figure of merit Computer Vision and Pattern Recognition Algorithm Software Word (computer architecture) |
| Zdroj: | Speech Communication. 9:329-336 |
| ISSN: | 0167-6393 |
| DOI: | 10.1016/0167-6393(90)90008-w |
| Popis: | This paper is concerned mainly with the choice of a figure of merit for representing the performance of connected-word recognisers when DP word-symbol sequence matching is used for the scoring. Properties of the DP scoring method are discussed. Experimental tests using data from the DARPA Resource Management Task confirm a prediction made from random number simulations that DP scoring overestimates substitution errors and underestimates insertion and deletion errors. As a result, the commonly used total error measure has a particularly large bias. The use of an alternative measure, percent correct, results in lower bias but ignores insertion errors. A new figure of merit, weighted total errors , takes all three kinds of errors into account and minimises bias. Finally, some more sophisticated figures of merit are discussed briefly. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|