Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Engage Grants Program

Université Laval

$25,000.00

Cloudfinity - Phase 1 Recognition of cockpit controls manipulation using COTS sensors

FY 2015-16

Summary
the trainer and the trainee be co-located at the same site during a training session. A distributed simulator training technology for which co-location of the trainee/trainer is not required, flight simulation training hardware/software is not co-located with client training platforms, and the cockpit environment of the training platform is rendered via virtual reality (as opposed to having physical cockpit panels) would have a significant economic impact since a trainer could follow the training sessions of many trainees located at remote locations simultaneously. To achieve this in a distributed environment, the activity of the trainee must be captured and displayed to the trainer. Important types of activity are the pose of the user in the platform and hand gestures performed when virtually manipulating different controls of the platform. In the long term, activity tracking in a representative aircraft simulator virtual cockpit should be possible. A first step for reaching this long term objective consists in monitoring trainee activity when interacting with a selection of typical controls on aircraft panels (or a virtual representation of these panels) and rendering this activity to the trainee/trainer in an immersive environment. The goals of the project are to recognize with good accuracy the hand gestures of the pilot when manipulating various controls, locate and detect which control is manipulated, establish optimal sensor configuration to detect manipulations on panels positioned on the overhead, glareshield and pedestal and use a virtual representation of panels for these manipulations. A challenge is that the sensors and displays must be low-cost COTS devices, be non-intrusive and function in
Program
Engage Grants Program
Location
Quebec, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
478004-2015
Name nom
Laurendeau, Denis
Department département
Génie électrique et génie informatique
Organization id
51
Institution établissement
Université Laval
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2015
Competition year année de concours
2015
Award amount
25000
Program id
EGP
Program name en
Engage Grants Program
Program name fr
Programme de subventions d'engagement partenariat
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
1552
Committee name en
Quebec Internal Decision Committee
Committee name fr
Comité de décision interne pour le Québec
Area of application code
703
Area of application group en
Transportation systems and services
Area of application group fr
Services et systèmes de transport
Area of application en
Aerospace
Area of application fr
Aérospatial
Research subject code
2800
Research subject group en
Artificial intelligence
Research subject group fr
Intelligence artificielle
Research subject en
Artificial intelligence (computer vision, use2603)
Research subject fr
Intelligence artificielle (vision artificielle, utiliser 2603)
Partie
1
Nb partie
1
Application title
Cloudfinity - Phase 1 Recognition of cockpit controls manipulation using COTS sensors
Keyword
NSERC
Application summary
the trainer and the trainee be co-located at the same site during a training session. A distributed simulator training technology for which co-location of the trainee/trainer is not required, flight simulation training hardware/software is not co-located with client training platforms, and the cockpit environment of the training platform is rendered via virtual reality (as opposed to having physical cockpit panels) would have a significant economic impact since a trainer could follow the training sessions of many trainees located at remote locations simultaneously. To achieve this in a distributed environment, the activity of the trainee must be captured and displayed to the trainer. Important types of activity are the pose of the user in the platform and hand gestures performed when virtually manipulating different controls of the platform. In the long term, activity tracking in a representative aircraft simulator virtual cockpit should be possible. A first step for reaching this long term objective consists in monitoring trainee activity when interacting with a selection of typical controls on aircraft panels (or a virtual representation of these panels) and rendering this activity to the trainee/trainer in an immersive environment. The goals of the project are to recognize with good accuracy the hand gestures of the pilot when manipulating various controls, locate and detect which control is manipulated, establish optimal sensor configuration to detect manipulations on panels positioned on the overhead, glareshield and pedestal and use a virtual representation of panels for these manipulations. A challenge is that the sensors and displays must be low-cost COTS devices, be non-intrusive and function in