A Nonverbal Recognition Method to Assist Speech

Author(s):Show less -

Meloni, Fernando ; Sicchieri, Bianca ; Mandra, Patricia ; Bulcao-Neto, Renato ; Macedo, Alessandra Alaniz ; Almeida, JR ; Gonzalez, AR ; Shen, L ; Kane, B ; Traina, A ; Soda, P ; Oliveira, JL

• Document type: Journal article
• Source: 2021 IEEE 34TH INTERNATIONAL SYMPOSIUM ON COMPUTER-BASED MEDICAL SYSTEMS (CBMS); v. N/A, p. 6-pg., 2021-01-01.

Abstract

For people with speech disorders, language therapies usually employ speech exercises performed at home, without close specialized supervision. There are fundamental movements to train speech ability called NonVerbal Praxis (NVP). These movements include blows and tongue snaps, which develop both the neuromotor capacities of people with apraxia and the pronunciation of phonemes. However, current research on NVP recognition has employed standard speech recognition techniques without much success. This paper describes a method to identify NVP under field conditions. The method covers the input audio signal segmentation until the audio segments are classified and scored. Our method was experimented with, and NVP sounds were efficiently classified, which helped guide patients and therapists through home therapy. It also provides valuable information for speech-language professionals to evaluate the patient's therapeutic performance. (AU)

• FAPESP's process: 16/13206-4 - Semnatic Enrichment of Medical Information from Networking Complex Heterogeneous
• Grantee: Alessandra Alaniz Macedo
• Support Opportunities: Regular Research Grants