Canada Spends Logo

Explorez notre analyse du budget 2026

Grant: Discovery Grants Program - Individual

University of Ottawa

$46,000.00

Deep Learning for Vision-based Measurement

EF 2022-23

Résumé
Deep learning techniques are remarkably successful on detection and recognition tasks in computer vision, reaching better than human performance in some specific applications. In my research I will develop novel learning-based algorithms and methods for virtual reality where data driven interaction and environment modelling, as well as user interfaces, can significantly benefit from advances in computer vision. Visual tracking allows different virtual reality and augmented reality devices to remain registered and synchronized. Motion estimation of surfaces, objects and actors is crucial in motion capture and 3D interaction modelling. Multi-view stereo captures real-word environments enabling navigation through these environment based on geometric relationships. My research program will significantly improve visual tracking, motion and stereo algorithms with learning-based techniques by focusing on vision based measurement. Vision based measurement uses the camera as a measurement instrument to obtain a measurand through an associated measurement procedure and with an uncertainty. This is crucial but often overlooked in virtual and augmented reality where different sensors and sensing results need to be fused with each other but also combined with physical reality. The geometry but also the appearance of captured objects and characters must not only appear realistic on their own but also when integrated into the whole virtual or augmented reality. In my research program, I will develop methods that on the one hand use physical constraints on the learning and on the other hand use learning to obtain physically plausible models. I will work on making consistent long-term tracking possible, develop real-time learning methods for motion estimation and 3D capture, thereby advancing the state-of-the-art in virtual and augmented reality through a focus on vision based measurement.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data

Tel que publié

Application id
RGPIN-2018-04405
Name nom
Lang, Jochen
Department département
Electrical Engineering and Computer Science , School of - science informatique et de génie électrique, École de
Organization id
28
Institution établissement
University of Ottawa
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2022
Competition year année de concours
2018
Award amount
46000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
801
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Computer software
Area of application fr
Logiciel
Research subject code
2700
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Information technology
Research subject fr
Technologie de l'information
Installment
inst:5;6
Partie
2
Nb partie
6
Application title
Deep Learning for Vision-based Measurement
Application summary
Deep learning techniques are remarkably successful on detection and recognition tasks in computer vision, reaching better than human performance in some specific applications. In my research I will develop novel learning-based algorithms and methods for virtual reality where data driven interaction and environment modelling, as well as user interfaces, can significantly benefit from advances in computer vision. Visual tracking allows different virtual reality and augmented reality devices to remain registered and synchronized. Motion estimation of surfaces, objects and actors is crucial in motion capture and 3D interaction modelling. Multi-view stereo captures real-word environments enabling navigation through these environment based on geometric relationships. My research program will significantly improve visual tracking, motion and stereo algorithms with learning-based techniques by focusing on vision based measurement. Vision based measurement uses the camera as a measurement instrument to obtain a measurand through an associated measurement procedure and with an uncertainty. This is crucial but often overlooked in virtual and augmented reality where different sensors and sensing results need to be fused with each other but also combined with physical reality. The geometry but also the appearance of captured objects and characters must not only appear realistic on their own but also when integrated into the whole virtual or augmented reality. In my research program, I will develop methods that on the one hand use physical constraints on the learning and on the other hand use learning to obtain physically plausible models. I will work on making consistent long-term tracking possible, develop real-time learning methods for motion estimation and 3D capture, thereby advancing the state-of-the-art in virtual and augmented reality through a focus on vision based measurement.