Detection and Evaluation of Speech Intelligibility with Speech Tool

Author(s)

Meloni, Fernando ; Sicchieri, Bianca B. ; Mandra, Patricia ; Bulcao-Neto, Renato de Freitas ; Macedo, Alessandra Alaniz ; IEEE

• Document type: Journal article
• Source: 2022 XVLIII LATIN AMERICAN COMPUTER CONFERENCE (CLEI 2022); v. N/A, p. 9-pg., 2022-01-01.

Abstract

The growth of assistive technologies brings new perspectives to Speech Sound Disorders (SSD) treatment. For example, automatic Speech Recognition (ASR) tools recognize and convert sound signals into text in multiple languages. Commonly, these tools rely on models trained with samples from typically developed speakers, but most of them can deal well with sonorous variations such as accents. Hence, there is an expectation that they may also transcribe phonological disorders, such as those produced by people with SSD. However, this potential remains poorly known. Here, we analyze the potential of one of the ASR tools, Google's speech-to-text API (c), as a multilevel indicator of speech intelligibility. We used pronunciations of volunteer actors, which simulated people with a broad spectrum of speech impairments. The tool indicated speech intelligibility at a general level and was marginally capable of determining the SSD type, but it could not map the syllable exchanges accurately. In short, our results suggest that ASRs have great potential as components of assistive tools in many contexts. Our contribution goes beyond the tests themselves, as we propose a simple, robust, systematic, and automated method to quantify speech intelligibility using ASRs. The method, which still needs clinical validation, can be replicated in other versions and tools and the pronunciations of people who are genuinely SSD carriers or in other languages, as long as they use the appropriate protocols. The goal is to enhance ASR tools' capabilities to promote even higher digital inclusion for people with phonological disorders. (AU)

• FAPESP's process: 16/13206-4 - Semnatic Enrichment of Medical Information from Networking Complex Heterogeneous
• Grantee: Alessandra Alaniz Macedo
• Support Opportunities: Regular Research Grants