Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Discovery Grants Program - Individual

Simon Fraser University

$27,000.00

Intelligent Model-Based Tracking of Natural Gait Motion in a Network of Depth Sensors

FY 2023-24

Summary
Tracking human body by observing its motion patterns in a natural living environment is a fundamental research area with many potential applications. In the past few years, advancement and widespread availability of commodity depth sensors, integrated with cameras have been offering a non-wearable alternative. This research concerns with some aspects of tracking motion of people in a network of sensors located at their natural living environment. Most existing approaches for processing the sensed depth information are incorporating complete or partial 3D depth data. Fundamental to our approach is the intelligent utilization of a collection 2D scan planes of the 3D data as a part of motion and scene representation. As a part of this investigation, it is proposed to investigate methods for determining initial changes in the sensed information due to movements. This detection can be used to assign and schedule sensors in the network and plan paths for mobile sensors. Each of the 1D depth profile in the associated scan planes can be further analyzed using Fourier analysis for defining components of feature vectors for further classification. It is proposed to explore the development of a 2D scan plane planner based on an intelligent particle filter tracking framework. As a part of this estimator, models for the gait movement patterns and postures of the subject are to be incorporated. The model-based estimator compares the sensed feature vectors with stored features associated with a number measured scans and generated key graphical postures and kinematic chain models of various limbs. The kinematic chain model is constructed using hierarchical description of particle filter starting from the kinematics of the torso to more detailed kinematic model of the connected limbs. In this work, we propose to explore the incorporation of visual information of hands and head based on skin color. This additional information will assist in further localization of hand extremities within the depth data for cases when the hand is in contact with the body (torso) or with various other limbs or body parts. We propose to approximate the head orientation during the gait pattern or various activities based on the depth data and face placement. For the cases where body occlusion is inevitable from sensor due to the presence of furniture (such as during the sitting down and raising from a chair), it is proposed to incorporate depth information from 2D scans of the furniture for defining its various feature vectors. We will compare this information with models of the stored features of furniture associated with the living environment to determine both types, position, and orientation of the furniture in relation to the subject.
Program
Discovery Grants Program - Individual
Location
British Columbia, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
RGPIN-2019-06434
Name nom
Payandeh, Shahram
Department département
Engineering Science, School of - Engineering Science, School of
Organization id
5
Institution établissement
Simon Fraser University
Province en
British Columbia
Province fr
Colombie-Britannique
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2023
Competition year année de concours
2019
Award amount
27000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1512
Committee name en
Mechanical Engineering
Committee name fr
Génie mécanique
Area of application code
1102
Area of application group en
Health, education and social services
Area of application group fr
Santé publique, éducation et services sociaux
Area of application en
Biomedical engineering
Area of application fr
Génie biomédical
Research subject code
2606
Research subject group en
Robotics
Research subject group fr
Systems, man and cybernetics
Research subject en
Robotique
Research subject fr
Systèmes, homme et cybernétique
Application title
Intelligent Model-Based Tracking of Natural Gait Motion in a Network of Depth Sensors
Keyword
Analysis of 2D Scan Planes of 3D Data; Body Extremities Detection in Depth and Visual Data; Depth Sensor Network; Intelligent Particle Filter; Kinematic Chain Estimation; Knowledge-Based Motion Estimation; Monitoring Human Motion; Natural Indoor Living Environmnt; Sensor Occlusion Handling; Signal Processing
Application summary
Tracking human body by observing its motion patterns in a natural living environment is a fundamental research area with many potential applications. In the past few years, advancement and widespread availability of commodity depth sensors, integrated with cameras have been offering a non-wearable alternative. This research concerns with some aspects of tracking motion of people in a network of sensors located at their natural living environment. Most existing approaches for processing the sensed depth information are incorporating complete or partial 3D depth data. Fundamental to our approach is the intelligent utilization of a collection 2D scan planes of the 3D data as a part of motion and scene representation. As a part of this investigation, it is proposed to investigate methods for determining initial changes in the sensed information due to movements. This detection can be used to assign and schedule sensors in the network and plan paths for mobile sensors. Each of the 1D depth profile in the associated scan planes can be further analyzed using Fourier analysis for defining components of feature vectors for further classification. It is proposed to explore the development of a 2D scan plane planner based on an intelligent particle filter tracking framework. As a part of this estimator, models for the gait movement patterns and postures of the subject are to be incorporated. The model-based estimator compares the sensed feature vectors with stored features associated with a number measured scans and generated key graphical postures and kinematic chain models of various limbs. The kinematic chain model is constructed using hierarchical description of particle filter starting from the kinematics of the torso to more detailed kinematic model of the connected limbs. In this work, we propose to explore the incorporation of visual information of hands and head based on skin color. This additional information will assist in further localization of hand extremities within the depth data for cases when the hand is in contact with the body (torso) or with various other limbs or body parts. We propose to approximate the head orientation during the gait pattern or various activities based on the depth data and face placement. For the cases where body occlusion is inevitable from sensor due to the presence of furniture (such as during the sitting down and raising from a chair), it is proposed to incorporate depth information from 2D scans of the furniture for defining its various feature vectors. We will compare this information with models of the stored features of furniture associated with the living environment to determine both types, position, and orientation of the furniture in relation to the subject.