Grant: Discovery Grants Program - Individual
University of Ottawa
$23,000.00
Real-time Tongue from Ultrasound
EF 2018-19
Résumé
*The motivation for our research is to develop a tongue visualization tool to help people who require speech therapy, who learn foreign languages, or who otherwise wish to see how they talk. The tongue is the most important articulator of speech and a large proportion of the research on tongue movement focuses on its role in speech. Many aural training applications exist but visual training is not mature. Unfortunately, the tongue is an organ difficult to see and hard to track using conventional camera or optical motion trackers. This has led to tongue motion visualization using MRI and ultrasound machines. The quality of MRI images is impressive, but it is prohibitively expensive and generally operates only in a noisy and constrained environment. While ultrasound does not have as high quality images, it is increasingly popular in phonetics research and medical imaging due to strong advantages such as non-invasive measurement, affordable equipment, portability, and real-time display of the tongue. We propose to use deep learning and other recent machine-learning techniques in developing a new algorithm for efficient, robust and real-time tongue segmentation from ultrasound imaging of the tongue in motion. This will lead to 3D tongue reconstruction and simulation, based only on a single sagittal view angle of the tongue captured by a ultrasound probe. We have previously performed static 3D reconstructions from semi-automatically segmented tongue ultrasound images but the present proposal focuses on real-time tongue segmentation. The result will provide visual feedback of mispronunciation through comparison with the tongue motion of a standard language speaker.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2018-06830
Name nom
Lee, WonSook
Department département
Engineering, Faculty of
Organization id
28
Institution établissement
University of Ottawa
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2018
Competition year année de concours
2018
Award amount
23000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2708
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Image processing
Research subject fr
Traitement des images
Partie
1
Nb partie
1
Application title
Real-time Tongue from Ultrasound
Keyword
NSERC
Application summary
*The motivation for our research is to develop a tongue visualization tool to help people who require speech therapy, who learn foreign languages, or who otherwise wish to see how they talk. The tongue is the most important articulator of speech and a large proportion of the research on tongue movement focuses on its role in speech. Many aural training applications exist but visual training is not mature. Unfortunately, the tongue is an organ difficult to see and hard to track using conventional camera or optical motion trackers. This has led to tongue motion visualization using MRI and ultrasound machines. The quality of MRI images is impressive, but it is prohibitively expensive and generally operates only in a noisy and constrained environment. While ultrasound does not have as high quality images, it is increasingly popular in phonetics research and medical imaging due to strong advantages such as non-invasive measurement, affordable equipment, portability, and real-time display of the tongue. We propose to use deep learning and other recent machine-learning techniques in developing a new algorithm for efficient, robust and real-time tongue segmentation from ultrasound imaging of the tongue in motion. This will lead to 3D tongue reconstruction and simulation, based only on a single sagittal view angle of the tongue captured by a ultrasound probe. We have previously performed static 3D reconstructions from semi-automatically segmented tongue ultrasound images but the present proposal focuses on real-time tongue segmentation. The result will provide visual feedback of mispronunciation through comparison with the tongue motion of a standard language speaker.