Grant: Discovery Grants Program - Individual
Memorial University of Newfoundland
$31,000.00
Task- and emotion-aware passive brain-computer interface for mental workload monitoring
FY 2016-17
Summary
Brain-computer interface (BCI) technologies have been traditionally defined as devices that enable movement-free communication through the direct measurement and translation of brain activity that is intentionally generated by the user for the purpose of controlling an external device. The target users of such ""active"" BCIs are generally individuals with severe motor impairments who are unable to operate more conventional interfaces (e.g., keyboards). Although this remains the focus of most BCI research, the potential of BCIs for healthy users has also been recognized and is receiving increased attention. The practical definition of BCIs is expanding to include not just those devices using brain activity to replace natural central nervous system (CNS) output in users with disability, but also those that enhance CNS output in healthy users. Rather than exploiting intentionally modulated brain activity, these so-called ""passive BCIs"" derive their outputs from arbitrary brain activity arising without the purpose of voluntary control, and are used instead for detecting the mental state (e.g., cognitive, affective) of the user. Passive BCIs have potential in many applications to enrich human-machine interaction by providing implicit information on the user's state and adapting the environment accordingly. One application domain that has received particular attention is the monitoring of mental workload, particularly in safety-critical occupations like pilots, air-traffic controllers, and other industrial operators. The ultimate goal is to derive a continuous, objective estimation of the cognitive strain on the individual from physiological signal variables, so that appropriate action can be taken to reduce the potential for error during periods of extreme demand or overload. Mental workload detection also has potential value in other domains, including gaming, adaptive training, and user interface design applications, to enhance and personalize user experience.
Previous studies support the feasibility of a passive BCI for automatic mental workload detection. However, to date only very basic functionality has been explored - specifically, the automatic detection of brain activity associated with different levels of difficulty of a given task under controlled conditions. While this is a critical first step, there is still much work to be done before such systems are suitable for widespread practical application, and much opportunity remains for enhancing reliability and functionality. In this research program, we will build upon the current state-of-the-art in passive BCIs for automatic mental workload detection. Specifically, we will work toward developing a system that is both task- and emotion-aware. The enhanced capability will result in improved user-state prediction, which will in turn allow for enhanced human-machine interaction in a variety of applications.
Program
Discovery Grants Program - Individual
Recipient
Location
Newfoundland and Labrador, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
RGPIN-2016-04210
Name nom
Power, Sarah
Department département
Engineering and Applied Science, Faculty of - Engineering and Applied Science, F
Organization id
89
Institution établissement
Memorial University of Newfoundland
Province en
Newfoundland and Labrador
Province fr
Terre-Neuve-et-Labrador
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2016
Competition year année de concours
2016
Award amount
31000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1510
Committee name en
Electrical and Computer Engineering
Committee name fr
Génie électrique et informatique
Area of application code
1102
Area of application group en
Health, education and social services
Area of application group fr
Santé publique, éducation et services sociaux
Area of application en
Biomedical engineering
Area of application fr
Génie biomédical
Research subject code
1901
Research subject group en
Biomedical engineering
Research subject group fr
Génie biomédical
Research subject en
Biomedical technology
Research subject fr
Technologie biomédicale
Partie
1
Nb partie
5
Application title
Task- and emotion-aware passive brain-computer interface for mental workload monitoring
Keyword
NSERC
Application summary
Brain-computer interface (BCI) technologies have been traditionally defined as devices that enable movement-free communication through the direct measurement and translation of brain activity that is intentionally generated by the user for the purpose of controlling an external device. The target users of such ""active"" BCIs are generally individuals with severe motor impairments who are unable to operate more conventional interfaces (e.g., keyboards). Although this remains the focus of most BCI research, the potential of BCIs for healthy users has also been recognized and is receiving increased attention. The practical definition of BCIs is expanding to include not just those devices using brain activity to replace natural central nervous system (CNS) output in users with disability, but also those that enhance CNS output in healthy users. Rather than exploiting intentionally modulated brain activity, these so-called ""passive BCIs"" derive their outputs from arbitrary brain activity arising without the purpose of voluntary control, and are used instead for detecting the mental state (e.g., cognitive, affective) of the user. Passive BCIs have potential in many applications to enrich human-machine interaction by providing implicit information on the user's state and adapting the environment accordingly. One application domain that has received particular attention is the monitoring of mental workload, particularly in safety-critical occupations like pilots, air-traffic controllers, and other industrial operators. The ultimate goal is to derive a continuous, objective estimation of the cognitive strain on the individual from physiological signal variables, so that appropriate action can be taken to reduce the potential for error during periods of extreme demand or overload. Mental workload detection also has potential value in other domains, including gaming, adaptive training, and user interface design applications, to enhance and personalize user experience.
Previous studies support the feasibility of a passive BCI for automatic mental workload detection. However, to date only very basic functionality has been explored - specifically, the automatic detection of brain activity associated with different levels of difficulty of a given task under controlled conditions. While this is a critical first step, there is still much work to be done before such systems are suitable for widespread practical application, and much opportunity remains for enhancing reliability and functionality. In this research program, we will build upon the current state-of-the-art in passive BCIs for automatic mental workload detection. Specifically, we will work toward developing a system that is both task- and emotion-aware. The enhanced capability will result in improved user-state prediction, which will in turn allow for enhanced human-machine interaction in a variety of applications.