Canada Spends Logo

Explorez notre analyse du budget 2026

Grant: Discovery Grants Program - Individual

University of Toronto

$51,000.00

Video-based analysis of human motion

EF 2012-13

Résumé
We spend a lot of time looking at people. Arguably, future computer systems will do so too, enabling new man-machine interfaces, perceptive consumer devices, smart surveillance systems, and myriad systems we have yet to envision. A key enabling technology for such purposes is video-based human pose tracking. The fidelity with which one needs to estimate 3D pose varies from task to task, but for most interesting applications current techniques are insufficient, especially when compared to the subtle movements with which humans communicate. The problems stem from the sheer number of joints in the body, which entails a high-dimensional estimation problem. Soft tissue and clothing obscure the skeleton, producing great variability in appearance, and further ambiguities are due to limited image resolution, the inability to distinguish which parts of an image correspond to which person, and because some body parts are occluded. To resolve ambiguities and reduce uncertainty caused by noisy (or missing) measurements, prior models play a key role in pose tracking, resolving an otherwise ambiguous estimation problem with a bias toward plausible human motions. This proposal concerns the formulation of computer vision techniques for pose estimation, tracking and the analysis of human motion from digital video. It also concerns the formulation of techniques for learning and optimizing models of human motion and pose. This includes the learning of kinematic models from motion capture data, the design and optimization of physics-based models to ensure that estimation motions are physically plausible, the formulation of models that facilitate the inference of interactions between a person and other objects in the environment, and models to support the inference of various physical attributes and mood from the way in which people move. The long-term goal is the formulation of models of how people move, and the estimation of human motion from digital video. Many potential applications exist beyond computer vision, including computer animation, biomechanics, rehabilitation and elder care.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data

Tel que publié

Application id
105391-2010
Name nom
Fleet, David
Department département
Computer Science (St. George Campus)
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2012
Competition year année de concours
2010
Award amount
51000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2603
Research subject group en
Robotics
Research subject group fr
Robotique
Research subject en
Computer vision
Research subject fr
Vision artificielle
Partie
3
Nb partie
5
Application title
Video-based analysis of human motion
Keyword
NSERC
Application summary
We spend a lot of time looking at people. Arguably, future computer systems will do so too, enabling new man-machine interfaces, perceptive consumer devices, smart surveillance systems, and myriad systems we have yet to envision. A key enabling technology for such purposes is video-based human pose tracking. The fidelity with which one needs to estimate 3D pose varies from task to task, but for most interesting applications current techniques are insufficient, especially when compared to the subtle movements with which humans communicate. The problems stem from the sheer number of joints in the body, which entails a high-dimensional estimation problem. Soft tissue and clothing obscure the skeleton, producing great variability in appearance, and further ambiguities are due to limited image resolution, the inability to distinguish which parts of an image correspond to which person, and because some body parts are occluded. To resolve ambiguities and reduce uncertainty caused by noisy (or missing) measurements, prior models play a key role in pose tracking, resolving an otherwise ambiguous estimation problem with a bias toward plausible human motions. This proposal concerns the formulation of computer vision techniques for pose estimation, tracking and the analysis of human motion from digital video. It also concerns the formulation of techniques for learning and optimizing models of human motion and pose. This includes the learning of kinematic models from motion capture data, the design and optimization of physics-based models to ensure that estimation motions are physically plausible, the formulation of models that facilitate the inference of interactions between a person and other objects in the environment, and models to support the inference of various physical attributes and mood from the way in which people move. The long-term goal is the formulation of models of how people move, and the estimation of human motion from digital video. Many potential applications exist beyond computer vision, including computer animation, biomechanics, rehabilitation and elder care.