Grant: Engage Grants Program
Université Laval
$24,783.00
Off body affective and cognitive monitoring for adaptive applications
EF 2017-18
Résumé
This Engage Project wishes to contribute to the development of innovative applications that can monitoremotional and cognitive states based on vocal prosody. Such applications will be beneficial since it will revealinformation about the interaction of two individuals, i.e. satisfaction or frustration, which can require anadjustment in strategy and stress detection or high workload, which can require reallocation of tasks anddemands. Cortex medias' application already includes verbal content recognition. Adding the online monitoringof emotional and cognitive states based on vocal prosody (the way something is said as opposed to the actuallinguistic meanings of the spoken words) will greatly enhance the validity of their application. Our approachcombines experimental psychology and cognitive ergonomics to integrate the automatic calculation and onlineassessment of vocal prosodic features for the recognition of emotions and cognitive traits. First, the applicationwill be further developed by integrating algorithms for the automatic calculation and online monitoring ofemotional and cognitive states during interactions between two individuals. The two dimensions used for theassessment will be satisfaction and workload. Second, the project will allow the refinement and validation ofthe implemented algorithms by corroborating evaluation from the prosodic features using physiologicalmeasures and a facial expression system. Results of this proposed project will define guidelines andrecommendations for designing applications that include recognition of users' emotional and cognitive statesbased on prosodic features. The outcomes of the project will positively impact the Canadian technological,financial and education sectors, as well as other areas such as public security, intelligent tutoring, e-health andthe gaming industry.
Programme
Engage Grants Program
Bénéficiaire
Emplacement
Quebec, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
514482-2017
Name nom
Tremblay, Sébastien
Department département
Psychologie, École de
Organization id
51
Institution établissement
Université Laval
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2017
Competition year année de concours
2017
Award amount
24783
Program id
EGP
Program name en
Engage Grants Program
Program name fr
Programme de subventions d'engagement partenariat
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
1552
Committee name en
Quebec Internal Decision Committee
Committee name fr
Comité de décision interne pour le Québec
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
6307
Research subject group en
Psychology
Research subject group fr
Psychologie
Research subject en
Cognitive science -- other
Research subject fr
Science cognitive -- autres
Partie
1
Nb partie
1
Application title
Off body affective and cognitive monitoring for adaptive applications
Keyword
NSERC
Application summary
This Engage Project wishes to contribute to the development of innovative applications that can monitoremotional and cognitive states based on vocal prosody. Such applications will be beneficial since it will revealinformation about the interaction of two individuals, i.e. satisfaction or frustration, which can require anadjustment in strategy and stress detection or high workload, which can require reallocation of tasks anddemands. Cortex medias' application already includes verbal content recognition. Adding the online monitoringof emotional and cognitive states based on vocal prosody (the way something is said as opposed to the actuallinguistic meanings of the spoken words) will greatly enhance the validity of their application. Our approachcombines experimental psychology and cognitive ergonomics to integrate the automatic calculation and onlineassessment of vocal prosodic features for the recognition of emotions and cognitive traits. First, the applicationwill be further developed by integrating algorithms for the automatic calculation and online monitoring ofemotional and cognitive states during interactions between two individuals. The two dimensions used for theassessment will be satisfaction and workload. Second, the project will allow the refinement and validation ofthe implemented algorithms by corroborating evaluation from the prosodic features using physiologicalmeasures and a facial expression system. Results of this proposed project will define guidelines andrecommendations for designing applications that include recognition of users' emotional and cognitive statesbased on prosodic features. The outcomes of the project will positively impact the Canadian technological,financial and education sectors, as well as other areas such as public security, intelligent tutoring, e-health andthe gaming industry.