Evaluating human corrections in a computer-assisted speaker diarization system

Autor: David Doukhan, Simon Petitrenaud, Jean Carrive, Pierre-Alexandre Broux, Sylvain Meignier
Přispěvatelé: Laboratoire d'Informatique de l'Université du Mans (LIUM), Le Mans Université (UM), Institut National de l'Audiovisuel (INA)
Jazyk: angličtina
Rok vydání: 2020
Předmět:
Zdroj: Language Resources and Evaluation
Language Resources and Evaluation, Springer Verlag, 2020, ⟨10.1007/s10579-020-09493-6⟩
ISSN: 1574-020X
1574-0218
DOI: 10.1007/s10579-020-09493-6⟩
Popis: In this paper, we present a framework to evaluate the human corrections of a speaker diarization system. We propose four elementary actions to correct the diarization (“Create a boundary”, “Delete a boundary”, “Create a speaker label” and “Change the speaker label”) and we propose an automaton to simulate the correction sequence. A metric is described to evaluate the correction cost. The framework is evaluated using French broadcast news drawn from the following campaigns: REPERE, ESTER and ETAPE.
Databáze: OpenAIRE