Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Collaborative Research and Development Grants

Université de Montréal

$34,782.00

Learning representations of players' emotions and state for next generation gaming

FY 2015-16

Summary
Computer and console gaming platforms are increasingly equiped with sensors, such as cameras and depth sensors, that can watch and track players while they are playing a game. It however remains a scientific and technical challenge to analyse this data in real time, beyond mere parts of body tracking, to reliably recognize and track a user's precise emotional state during gameplay. With our Montreal-based partner Ubisoft, we propose to leverage recent advances in machine learning techniques to achieve this. Specifically we will employ recent approaches for training deep neural networks on big datasets, to learn a mapping between a player's captured images (especially the face) and emotional state. The research will focus on improving these techniques to allow fast and transparent adaptation to each player's specific modes of facial expression. The Canadian computer gaming industry would gain a major competitive advantage thanks to such technology, since the ability of a gaming system to accurately perceive a player's emotional state in real time will enable the game to adapt to it, and is anticipated to be the key for crafting the next generation of truly immersive gaming experience.
Program
Collaborative Research and Development Grants
Location
Quebec, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
447414-2013
Name nom
Vincent, Pascal
Department département
Informatique et recherche opérationnelle
Organization id
63
Institution établissement
Université de Montréal
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2015
Competition year année de concours
2013
Award amount
34782
Program id
CRDPJ
Program name en
Collaborative Research and Development Grants
Program name fr
Subventions de recherche et développement coopérative
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
96
Committee name en
RPP Internal Decision Cttee
Committee name fr
Cté de décision interne - PPR
Area of application code
801
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Computer software
Area of application fr
Logiciel
Research subject code
2805
Research subject group en
Artificial intelligence
Research subject group fr
Intelligence artificielle
Research subject en
Learning and inference theories
Research subject fr
Théories de l'apprentissage et l'inférence
Partie
3
Nb partie
3
Application title
Learning representations of players' emotions and state for next generation gaming
Keyword
NSERC
Application summary
Computer and console gaming platforms are increasingly equiped with sensors, such as cameras and depth sensors, that can watch and track players while they are playing a game. It however remains a scientific and technical challenge to analyse this data in real time, beyond mere parts of body tracking, to reliably recognize and track a user's precise emotional state during gameplay. With our Montreal-based partner Ubisoft, we propose to leverage recent advances in machine learning techniques to achieve this. Specifically we will employ recent approaches for training deep neural networks on big datasets, to learn a mapping between a player's captured images (especially the face) and emotional state. The research will focus on improving these techniques to allow fast and transparent adaptation to each player's specific modes of facial expression. The Canadian computer gaming industry would gain a major competitive advantage thanks to such technology, since the ability of a gaming system to accurately perceive a player's emotional state in real time will enable the game to adapt to it, and is anticipated to be the key for crafting the next generation of truly immersive gaming experience.