Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Discovery Grants Program - Individual

Simon Fraser University

$27,000.00

Study of Kinematic Tracking and Monitoring of Human Movements in a Collaborative Network of Depth Sensors

FY 2017-18

Summary
Tracking human body movement by observing motion patterns is a fundamental research area with many potential applications, such as human gait analysis, monitoring seniors in independent living facilities, human-robot interaction, and surveillance. To date, networks of cameras or wearable sensors have been utilized to capture human body movements. However, visual sensing has struggled to overcome variations in illumination and surface texture properties, and wearable sensors have faced poor acceptance. A more feasible and economical approach is currently being developed using low cost kinematic depth sensors, which are an emerging technology. The proposed research program will target the aspects of robust motion tracking of people through a network of distributed depth sensors.Research results will contribute to the field of human biomechanics and robotics and benefit Canadians in a number of ways. The research will provide a practical tool that can be used in patient rehabilitation by observing their movements in their natural living habitat without the inconvenience of wearing sensors; it will also offer a unique, non-intrusive approach for their deployment in monitoring activities of our aging population for their safety in private or public caregiving facilities. This investigation will undertake development of novel calibration methods for various networks of depth sensing technologies, modeling and understanding the nature of noise and sensitivity of measurements related to the location of bodies and movements of limbs. Two kinematic tracking models are proposed based on the depth measurements: a coarse tracking model; and a fine tracking model. In the coarse model, we define the overall surrounding shape of persons based on points at extremities and the novel method based on shapes of cross-sectional cuts. We propose to extend the notion of dividing the physical monitoring area into coarser volumes (e.g., cubes) and associate the distributed depth measurements to corresponding 3D volumes. For each volume, we will explore various approaches for finding a suitable representation of the surface prescribed by measured depth information. The reconstructed coarse shape model is then used as a basis for tracking selected limbs of the person, e.g. arms, feet, and head. First, information about the location of extremities is used to define a local distance function along the mesh model between them. For each limb occupying a set of cubes, tracking variables will be defined to represent the underlying skeleton and local simple geometrical shape of the limb. Due to natural uncertainties associated with body and limb movements, a tracking method for each limb is proposed based on a novel intelligent filter framework (intelligent particle filter). I plan to develop, study, and experiment with various motion models of the tracking variables and prior motion probability distributions that can represent the knowledge of expected tracking variables at each time step. Then a set of predicted tracking variables will be defined that can be compared and weighted with the actual measured depth sensor information. The expected novel contributions are associated with development of a robust model-based switching method for tracking as a function of global motion intentions of the person and the local motion patterns of the selected limbs. The overall objective is to start by tracking one person and their associated limbs and extend the results to multiple people moving in the monitoring area. At each stage of the development, incremental results will be validated against an existing marker-based system and compared with other known motion prediction methods.
Program
Discovery Grants Program - Individual
Location
British Columbia, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
RGPIN-2014-04160
Name nom
Payandeh, Shahram
Department département
Engineering Science, School of
Organization id
5
Institution établissement
Simon Fraser University
Province en
British Columbia
Province fr
Colombie-Britannique
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2017
Competition year année de concours
2014
Award amount
27000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1512
Committee name en
Mechanical Engineering
Committee name fr
Génie mécanique
Area of application code
1102
Area of application group en
Health, education and social services
Area of application group fr
Santé publique, éducation et services sociaux
Area of application en
Biomedical engineering
Area of application fr
Génie biomédical
Research subject code
1903
Research subject group en
Biomedical engineering
Research subject group fr
Génie biomédical
Research subject en
Biomechanics
Research subject fr
Biomécanique
Partie
4
Nb partie
5
Application title
Study of Kinematic Tracking and Monitoring of Human Movements in a Collaborative Network of Depth Sensors
Keyword
NSERC
Application summary
Tracking human body movement by observing motion patterns is a fundamental research area with many potential applications, such as human gait analysis, monitoring seniors in independent living facilities, human-robot interaction, and surveillance. To date, networks of cameras or wearable sensors have been utilized to capture human body movements. However, visual sensing has struggled to overcome variations in illumination and surface texture properties, and wearable sensors have faced poor acceptance. A more feasible and economical approach is currently being developed using low cost kinematic depth sensors, which are an emerging technology. The proposed research program will target the aspects of robust motion tracking of people through a network of distributed depth sensors.Research results will contribute to the field of human biomechanics and robotics and benefit Canadians in a number of ways. The research will provide a practical tool that can be used in patient rehabilitation by observing their movements in their natural living habitat without the inconvenience of wearing sensors; it will also offer a unique, non-intrusive approach for their deployment in monitoring activities of our aging population for their safety in private or public caregiving facilities. This investigation will undertake development of novel calibration methods for various networks of depth sensing technologies, modeling and understanding the nature of noise and sensitivity of measurements related to the location of bodies and movements of limbs. Two kinematic tracking models are proposed based on the depth measurements: a coarse tracking model; and a fine tracking model. In the coarse model, we define the overall surrounding shape of persons based on points at extremities and the novel method based on shapes of cross-sectional cuts. We propose to extend the notion of dividing the physical monitoring area into coarser volumes (e.g., cubes) and associate the distributed depth measurements to corresponding 3D volumes. For each volume, we will explore various approaches for finding a suitable representation of the surface prescribed by measured depth information. The reconstructed coarse shape model is then used as a basis for tracking selected limbs of the person, e.g. arms, feet, and head. First, information about the location of extremities is used to define a local distance function along the mesh model between them. For each limb occupying a set of cubes, tracking variables will be defined to represent the underlying skeleton and local simple geometrical shape of the limb. Due to natural uncertainties associated with body and limb movements, a tracking method for each limb is proposed based on a novel intelligent filter framework (intelligent particle filter). I plan to develop, study, and experiment with various motion models of the tracking variables and prior motion probability distributions that can represent the knowledge of expected tracking variables at each time step. Then a set of predicted tracking variables will be defined that can be compared and weighted with the actual measured depth sensor information. The expected novel contributions are associated with development of a robust model-based switching method for tracking as a function of global motion intentions of the person and the local motion patterns of the selected limbs. The overall objective is to start by tracking one person and their associated limbs and extend the results to multiple people moving in the monitoring area. At each stage of the development, incremental results will be validated against an existing marker-based system and compared with other known motion prediction methods.