Grant: Engage Grants Program
Université Laval
$25,000.00
Cloudfinity - Phase 1 Recognition of cockpit controls manipulation using COTS sensors
EF 2015-16
Résumé
the trainer and the trainee be co-located at the same site during a training session.
A distributed simulator training technology for which co-location of the trainee/trainer is not required, flight
simulation training hardware/software is not co-located with client training platforms, and the cockpit
environment of the training platform is rendered via virtual reality (as opposed to having physical cockpit
panels) would have a significant economic impact since a trainer could follow the training sessions of many
trainees located at remote locations simultaneously. To achieve this in a distributed environment, the activity of
the trainee must be captured and displayed to the trainer. Important types of activity are the pose of the user in
the platform and hand gestures performed when virtually manipulating different controls of the platform. In the
long term, activity tracking in a representative aircraft simulator virtual cockpit should be possible. A first step
for reaching this long term objective consists in monitoring trainee activity when interacting with a selection of
typical controls on aircraft panels (or a virtual representation of these panels) and rendering this activity to the
trainee/trainer in an immersive environment.
The goals of the project are to recognize with good accuracy the hand gestures of the pilot when manipulating
various controls, locate and detect which control is manipulated, establish optimal sensor configuration to
detect manipulations on panels positioned on the overhead, glareshield and pedestal and use a virtual
representation of panels for these manipulations.
A challenge is that the sensors and displays must be low-cost COTS devices, be non-intrusive and function in
Programme
Engage Grants Program
Bénéficiaire
Emplacement
Quebec, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
478004-2015
Name nom
Laurendeau, Denis
Department département
Génie électrique et génie informatique
Organization id
51
Institution établissement
Université Laval
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2015
Competition year année de concours
2015
Award amount
25000
Program id
EGP
Program name en
Engage Grants Program
Program name fr
Programme de subventions d'engagement partenariat
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
1552
Committee name en
Quebec Internal Decision Committee
Committee name fr
Comité de décision interne pour le Québec
Area of application code
703
Area of application group en
Transportation systems and services
Area of application group fr
Services et systèmes de transport
Area of application en
Aerospace
Area of application fr
Aérospatial
Research subject code
2800
Research subject group en
Artificial intelligence
Research subject group fr
Intelligence artificielle
Research subject en
Artificial intelligence (computer vision, use2603)
Research subject fr
Intelligence artificielle (vision artificielle, utiliser 2603)
Partie
1
Nb partie
1
Application title
Cloudfinity - Phase 1 Recognition of cockpit controls manipulation using COTS sensors
Keyword
NSERC
Application summary
the trainer and the trainee be co-located at the same site during a training session.
A distributed simulator training technology for which co-location of the trainee/trainer is not required, flight
simulation training hardware/software is not co-located with client training platforms, and the cockpit
environment of the training platform is rendered via virtual reality (as opposed to having physical cockpit
panels) would have a significant economic impact since a trainer could follow the training sessions of many
trainees located at remote locations simultaneously. To achieve this in a distributed environment, the activity of
the trainee must be captured and displayed to the trainer. Important types of activity are the pose of the user in
the platform and hand gestures performed when virtually manipulating different controls of the platform. In the
long term, activity tracking in a representative aircraft simulator virtual cockpit should be possible. A first step
for reaching this long term objective consists in monitoring trainee activity when interacting with a selection of
typical controls on aircraft panels (or a virtual representation of these panels) and rendering this activity to the
trainee/trainer in an immersive environment.
The goals of the project are to recognize with good accuracy the hand gestures of the pilot when manipulating
various controls, locate and detect which control is manipulated, establish optimal sensor configuration to
detect manipulations on panels positioned on the overhead, glareshield and pedestal and use a virtual
representation of panels for these manipulations.
A challenge is that the sensors and displays must be low-cost COTS devices, be non-intrusive and function in