The Harrington Yowlumne Narrative Corpus

Autor: White, Nathan M., Henry-Rodriguez, Timothy
Rok vydání: 2021
Předmět:
Druh dokumentu: Working Paper
Popis: Minority languages continue to lack adequate resources for their development, especially in the technological domain. Likewise, the J.P. Harrington Papers collection at the Smithsonian Institution are difficult to access in practical terms for community members and researchers due to its handwritten and disorganized format. Our current work seeks to make a portion of this publicly-available yet problematic material practically accessible for natural language processing use. Here, we present the Harrington Yowlumne Narrative Corpus, a corpus of 20 narrative texts that derive from the Tejone\~no Yowlumne community of the Tinliw rancheria in Kern County, California between 1910 and 1925. We digitally transcribe the texts and, through a Levenshtein distance-based algorithm and manual checking, we provide gold-standard aligned normalized and lemmatized text. We likewise provide POS tags for each lemmatized token via a lexicon-based deterministic approach. Altogether, the corpus contains 57,136 transcribed characters aligned with 10,719 gold standard text-normalized words.
Databáze: arXiv