Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Discovery Grants Program - Individual

École de technologie supérieure

$22,000.00

Emotion detection from voice recordings

FY 2017-18

Summary
The speech signal carries several levels of information. From a voice recording, we can extract pronounced words, the speakers identity, the spoken language or even the speakers emotional state. In the last five years, there has been a great increase of interest in the field of emotion recognition based on different human modalities, such as speech, heart rate, etc. Building a robust emotion detection system can be very useful in several areas such as medicine and telecommunications. In the medical field, detecting emotions in general can be considered an important tool for diagnosing and following patients suffering from depression. The identification of the emotional state of a person from his voice opens new perspectives for the development of an automated dialogue system, one capable of communicating with patients at home daily and even several times a day to produce a report for the physician. Although much research has been done, actual emotion recognition systems performances are still not adequate for these real life applications. The majority of emotion detection systems have been designed by focussing on the speech modeling rather than the feature extraction aspect. Usually, feature vectors are made of a combination of classical cepstral features (such as MFCC) augmented with some prosodic characteristics (such as speech intonation). The modest results presented in the literature make us think that we should focus on improving the quality of features used for training emotion identification systems instead of focussing on the modeling aspect. For this reason, our research will focus on extracting more accurate features from the speech signal. Three main axes will be established in order to reach this objective. The first axe consists of working on the development of a DNN architecture capable of learning the classification function directly from the raw speech signal. The second axe consists of developing another DNN architecture capable of learning a normalization function in order to be able to mix different databases made of speech signals from different recording conditions. Finally, in the third axe, we will concentrate on high-level features such as phoneme durations and other evidence extracted from words said by the speaker. Improvements made during this research will be very practical for building reliable healthcare applications. Indeed, s uch applications would be useful for health professionals by helping them improve the quality of treatments in Canada. Moreover, our findings could be applied to several other fields of speech technologies. The approach presented would facilitate the development of command and control applications without the use of a complex and time/power consuming speech recognition engine. This would help start-ups or small businesses in Canada to add voice-based control to their applications without needing to hire a speech recognition specialist.
Program
Discovery Grants Program - Individual
Location
Quebec, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
RGPIN-2016-06628
Name nom
Cardinal, Patrick
Department département
Génie logiciel et des TI - Génie logiciel et des TI
Organization id
53
Institution établissement
École de technologie supérieure
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2017
Competition year année de concours
2016
Award amount
22000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
1206
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Engineering
Area of application fr
Génie
Research subject code
2801
Research subject group en
Artificial intelligence
Research subject group fr
Intelligence artificielle
Research subject en
Natural language and speech understanding
Research subject fr
Langage naturel et reconnaissance de la parole
Partie
2
Nb partie
5
Application title
Emotion detection from voice recordings
Keyword
NSERC
Application summary
The speech signal carries several levels of information. From a voice recording, we can extract pronounced words, the speakers identity, the spoken language or even the speakers emotional state. In the last five years, there has been a great increase of interest in the field of emotion recognition based on different human modalities, such as speech, heart rate, etc. Building a robust emotion detection system can be very useful in several areas such as medicine and telecommunications. In the medical field, detecting emotions in general can be considered an important tool for diagnosing and following patients suffering from depression. The identification of the emotional state of a person from his voice opens new perspectives for the development of an automated dialogue system, one capable of communicating with patients at home daily and even several times a day to produce a report for the physician. Although much research has been done, actual emotion recognition systems performances are still not adequate for these real life applications. The majority of emotion detection systems have been designed by focussing on the speech modeling rather than the feature extraction aspect. Usually, feature vectors are made of a combination of classical cepstral features (such as MFCC) augmented with some prosodic characteristics (such as speech intonation). The modest results presented in the literature make us think that we should focus on improving the quality of features used for training emotion identification systems instead of focussing on the modeling aspect. For this reason, our research will focus on extracting more accurate features from the speech signal. Three main axes will be established in order to reach this objective. The first axe consists of working on the development of a DNN architecture capable of learning the classification function directly from the raw speech signal. The second axe consists of developing another DNN architecture capable of learning a normalization function in order to be able to mix different databases made of speech signals from different recording conditions. Finally, in the third axe, we will concentrate on high-level features such as phoneme durations and other evidence extracted from words said by the speaker. Improvements made during this research will be very practical for building reliable healthcare applications. Indeed, s uch applications would be useful for health professionals by helping them improve the quality of treatments in Canada. Moreover, our findings could be applied to several other fields of speech technologies. The approach presented would facilitate the development of command and control applications without the use of a complex and time/power consuming speech recognition engine. This would help start-ups or small businesses in Canada to add voice-based control to their applications without needing to hire a speech recognition specialist.
École de technologie supérieure - $22,000 Grant (2017… | Canada Spends