Grant: Discovery Grants Program - Individual
University of Toronto
$58,000.00
Computer Vision Systems to Analyse Face and Body Movements, to Automated the Assessment of Physical Health, Mobility, and Safety in Natural Settings and Over Time
EF 2024-25
Résumé
My area of research is the development of computer vision systems and algorithms for intelligent health monitoring and rehabilitation technologies. Over the next five years I will focus my work on two important topics in this area: 1) using and advancing recent developments in machine learning to improve how temporal and longitudinal information is incorporated in computer vision health assessment, and 2) fairness and bias in computer vision systems, particularly with respect to old age and disability.
1) Longitudinal health data often contains large amounts of missing information and is almost always irregularly sampled. Principled approaches to model missing data and irregular sampling include Gaussian Processes and, more recently, Neural Ordinary Differential Equations. My research will augment and advance these approaches to take advantage of additional information, including the patterns of missing information and the temporal distribution of samples. I will also investigate how Transformer Networks could be applied to process long-term trends in healthcare image/video data and in relation to other parameters of health or relevant information.
2) My work has identified fairness and bias issues related to the performance of state-of-the-art computer vision facial analysis models on faces of older adults with a physical or cognitive disability, e.g. stroke or dementia. This is an important limiting factor in employing computer systems in healthcare solutions. Deep learning models used to obtain best performing results on standard benchmarks are typically trained on hundreds of thousands to millions of training examples. It is not practical to collect representative examples of this size from various clinical populations to include in the training data. Patient data and identifiable health records (e.g. face images) are highly sensitive and access is often restricted. A more realistic solution is to collect targeted represented training sets and to adapt state-of-the-art models trained on standard benchmarks datasets to the target population via transfer learning. In my work so far, I have examined commonly used transfer techniques, and have also developed and evaluated novel transfer techniques for this purpose. Using these methods, the performance of facial analysis models on target populations improves, but the gap in performance between clinical and healthy populations persists. Over the next few years, I plan to expand my work in this area and, specifically, explore the use of counterfactual inference and uncertainty quantification to improve the performance of transfer learning techniques, particularly as related to computer vision systems used in facial and body movement analysis.
This program of research will train seven HQPs and will result in innovative solutions to reduce bias and to better incorporate long-term temporal information in computer vision systems.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2020-04184
Name nom
Taati, Babak
Department département
Research
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2024
Competition year année de concours
2020
Award amount
58000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
1101
Area of application group en
Health, education and social services
Area of application group fr
Santé publique, éducation et services sociaux
Area of application en
Human health (including medically-related psychological research)
Area of application fr
Santé publique (y compris recherche psychologique liée à la médecine)
Research subject code
2604
Research subject group en
Robotics
Research subject group fr
Robotique
Research subject en
Intelligent systems applications
Research subject fr
Applications de systèmes intelligents
Field of research list names en
Not available
Field of research list names fr
Non disponible
Socioeconomic objective list names en
Not available
Socioeconomic objective list names fr
Non disponible
Application title
Computer Vision Systems to Analyse Face and Body Movements, to Automated the Assessment of Physical Health, Mobility, and Safety in Natural Settings and Over Time
Keywords
computer vision; automated health and safety monitoring; gait analysis; facial expression analysis; intelligent rehabilitation technologies; fairness and bias; smart homes
Application summary
My area of research is the development of computer vision systems and algorithms for intelligent health monitoring and rehabilitation technologies. Over the next five years I will focus my work on two important topics in this area: 1) using and advancing recent developments in machine learning to improve how temporal and longitudinal information is incorporated in computer vision health assessment, and 2) fairness and bias in computer vision systems, particularly with respect to old age and disability.
1) Longitudinal health data often contains large amounts of missing information and is almost always irregularly sampled. Principled approaches to model missing data and irregular sampling include Gaussian Processes and, more recently, Neural Ordinary Differential Equations. My research will augment and advance these approaches to take advantage of additional information, including the patterns of missing information and the temporal distribution of samples. I will also investigate how Transformer Networks could be applied to process long-term trends in healthcare image/video data and in relation to other parameters of health or relevant information.
2) My work has identified fairness and bias issues related to the performance of state-of-the-art computer vision facial analysis models on faces of older adults with a physical or cognitive disability, e.g. stroke or dementia. This is an important limiting factor in employing computer systems in healthcare solutions. Deep learning models used to obtain best performing results on standard benchmarks are typically trained on hundreds of thousands to millions of training examples. It is not practical to collect representative examples of this size from various clinical populations to include in the training data. Patient data and identifiable health records (e.g. face images) are highly sensitive and access is often restricted. A more realistic solution is to collect targeted represented training sets and to adapt state-of-the-art models trained on standard benchmarks datasets to the target population via transfer learning. In my work so far, I have examined commonly used transfer techniques, and have also developed and evaluated novel transfer techniques for this purpose. Using these methods, the performance of facial analysis models on target populations improves, but the gap in performance between clinical and healthy populations persists. Over the next few years, I plan to expand my work in this area and, specifically, explore the use of counterfactual inference and uncertainty quantification to improve the performance of transfer learning techniques, particularly as related to computer vision systems used in facial and body movement analysis.
This program of research will train seven HQPs and will result in innovative solutions to reduce bias and to better incorporate long-term temporal information in computer vision systems.