Canada Spends Logo

Explorez notre analyse du budget 2026

Grant: Collaborative Research and Development Grants

Université de Montréal

$120,000.00

A biometric environment, neural control and A.I guidance for assessing video games and immersions

EF 2015-16

Résumé
This research is aimed at developing tools that recognize the emotions and cognitive states of users in a video game situation, and methods to reduce and control their impact . Recognition and control will be based on Artificial Intelligence (AI) techniques such as machine learning and agents. We aim to set up the tools able to measure emotional engagement and workload using games environments and immersions. For instance, we want to identify scenes in a video game which provide positive or negative emotions, fun, boredom, attraction, etc. A Biometric environment will be able to identify frustrating elements as well as motivating scenes. To allow that we intend to develop an Augmented Reality (AR) and Virtual Reality (VR) glasses environment control and tools to assess and leverage emotional components which arise when a user interacts. As well, we intend to identify, adapt and optimize the best neural control input methods and AI avatar guidance for AR and VR glasses. With these aspects in mind, we wish to develop tools for the detection and analysis of emotional and cognitive reactions during interactions in order to improve the user-friendliness of human-machine interfaces and video games. The scientific approach will be based on targeting several biometric tools which functionalities will be progressively defined. Then the tools will be implemented and tested in several video games and immersions suitable for AR and VR glasses. Neural agents will be developed to follow and influence user's emotions. The Biometric environment is supported by a CFI grant that we have obtained and which provides access to numerous tools for assessing emotional and behavioral conditions of user interactions in a game (EEG systems, Eye tracking systems and glasses, Virtual Reality Helmets, Powerful Computers, Biopac systems, Face reader systems). Experiments and the development of new algorithms will lead to the possibility of developing a new generation of games, which are influenced in real time by eye movements, facial expressions or concentration.
Programme
Collaborative Research and Development Grants
Emplacement
Quebec, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data

Tel que publié

Application id
476544-2014
Name nom
Frasson, Claude
Department département
Informatique et recherche opérationnelle
Organization id
63
Institution établissement
Université de Montréal
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2015
Competition year année de concours
2014
Award amount
120000
Program id
CRDPJ
Program name en
Collaborative Research and Development Grants
Program name fr
Subventions de recherche et développement coopérative
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
141
Committee name en
University/Industry
Committee name fr
Universités/industrie
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2800
Research subject group en
Artificial intelligence
Research subject group fr
Intelligence artificielle
Research subject en
Artificial intelligence (computer vision, use2603)
Research subject fr
Intelligence artificielle (vision artificielle, utiliser 2603)
Partie
1
Nb partie
2
Application title
A biometric environment, neural control and A.I guidance for assessing video games and immersions
Keyword
NSERC
Application summary
This research is aimed at developing tools that recognize the emotions and cognitive states of users in a video game situation, and methods to reduce and control their impact . Recognition and control will be based on Artificial Intelligence (AI) techniques such as machine learning and agents. We aim to set up the tools able to measure emotional engagement and workload using games environments and immersions. For instance, we want to identify scenes in a video game which provide positive or negative emotions, fun, boredom, attraction, etc. A Biometric environment will be able to identify frustrating elements as well as motivating scenes. To allow that we intend to develop an Augmented Reality (AR) and Virtual Reality (VR) glasses environment control and tools to assess and leverage emotional components which arise when a user interacts. As well, we intend to identify, adapt and optimize the best neural control input methods and AI avatar guidance for AR and VR glasses. With these aspects in mind, we wish to develop tools for the detection and analysis of emotional and cognitive reactions during interactions in order to improve the user-friendliness of human-machine interfaces and video games. The scientific approach will be based on targeting several biometric tools which functionalities will be progressively defined. Then the tools will be implemented and tested in several video games and immersions suitable for AR and VR glasses. Neural agents will be developed to follow and influence user's emotions. The Biometric environment is supported by a CFI grant that we have obtained and which provides access to numerous tools for assessing emotional and behavioral conditions of user interactions in a game (EEG systems, Eye tracking systems and glasses, Virtual Reality Helmets, Powerful Computers, Biopac systems, Face reader systems). Experiments and the development of new algorithms will lead to the possibility of developing a new generation of games, which are influenced in real time by eye movements, facial expressions or concentration.