The Effect of Rating Method on Reliability of Judgments of Strain Across Populations.

Autor: Sauder CL; Department of Speech & Hearing Sciences, University of Washington, Seattle., Kapsner-Smith MR; Department of Speech & Hearing Sciences, University of Washington, Seattle., Simmons E; Department of Speech & Hearing Sciences, University of Washington, Seattle., Meyer T; Department of Otolaryngology-Head & Neck Surgery, University of Washington School of Medicine, Seattle., Doyle PC; Division of Laryngology, Department of Otolaryngology-Head & Neck Surgery, Stanford University School of Medicine, CA., Eadie TL; Department of Speech & Hearing Sciences, University of Washington, Seattle.; Department of Otolaryngology-Head & Neck Surgery, University of Washington School of Medicine, Seattle.
Jazyk: angličtina
Zdroj: American journal of speech-language pathology [Am J Speech Lang Pathol] 2024 Jan 03; Vol. 33 (1), pp. 393-405. Date of Electronic Publication: 2023 Dec 07.
DOI: 10.1044/2023_AJSLP-23-00174
Abstrakt: Purpose: Variability in auditory-perceptual ratings of voice limits their utility, with the poorest reliability often noted for vocal strain. The purpose of this study was to determine whether an experimental method, called visual sort and rate (VSR), promoted stronger rater reliability than visual analog scale (VAS), for ratings of strain in two clinical populations: adductor laryngeal dystonia (ADLD) and vocal hyperfunction (VH).
Method: Connected speech samples from speakers with ADLD and VH as well as age- and sex-matched controls were selected from a database. Fifteen inexperienced listeners rated strain for two speaker sets (25 ADLD speakers and five controls; 25 VH speakers and five controls) across four rating blocks: VAS-ADLD, VSR-ADLD, VAS-VH, and VSR-VH. For the VAS task, listeners rated each speaker for strain using a vertically oriented 100-mm VAS. For the VSR task, stimuli were distributed into sets of samples with a range of severities in each set. Listeners sorted and ranked samples for strain within each set, and final ratings were captured on a vertically oriented 100-mm VAS. Intrarater reliability (Pearson's r ) and interrater variability (mean of the squared differences between a listener's ratings and group mean ratings) were compared across rating methods and populations using two repeated-measures analyses of variance.
Results: Intrarater reliability of strain was significantly stronger when listeners used VSR compared to VAS; listeners also showed significantly better intrarater reliability in ADLD than VH. Listeners demonstrated significantly less interrater variability (better reliability) when using VSR compared to VAS. No significant effect of population or interactions was found between listeners for measures of interrater variability.
Conclusions: VSR increases intrarater reliability for ratings of vocal strain in speakers with VH and ADLD. VSR decreases variability of auditory-perceptual judgments of strain between inexperienced listeners in these clinical populations. Future research should determine whether benefits of VSR extend to voice clinicians and/or clinical settings.
Databáze: MEDLINE
Externí odkaz: