Grant: Discovery Grants Program - Individual
University of Victoria
$31,000.00
Real-Time Modeling and Registration of Dynamic Geometry
EF 2017-18
Résumé
The augmented reality market is forecast to reach $120 billion by 2020. The advent of consumer-level augmented reality devices (e.g. Microsoft HoloLens) has been fuelled by technological leaps in real-time sensors capable of simultaneously capturing colour and depth (e.g. Microsoft Kinect). While these sensors provide a way of measuring the 3D geometry of the real world, processing geometry in real-time is particularly challenging. For example, many techniques only focus on specific sub-problems like face, body or hand tracking, and thus often assume the object being observed by the camera is of known geometry. Adapting these algorithms to cope with an unknown, dynamic and ever-changing environment is a fundamental challenge, especially when targeting real-time applications with their conflicting requirements of efficiency and power consumption. To face these challenges, my students and I will investigate a way to represent geometry that is different from what is typically adopted by the computer graphics and vision communities. This representation, a particular variant of the so-called convolution surfaces is used today by 3D artists to efficiently design the coarse articulated structure of digital content. Their mathematical properties make them ideal for virtual reality applications, as geometric queries essential to real-time registration algorithms (i.e. tracking) can be answered with extreme efficiency. Furthermore, these models can also be easily adapted to changes in geometry, thus making them suitable to represent our ever-changing world. My research team will approach this investigation from three different angles. We will (1) study how to reverse engineer convolution surfaces from digital and acquired data; (2) investigate their use and scalability in real-time consumer applications; and (3) develop a cost-effective omnidirectional 3D acquisition system. The latter will help us devise statistical models allowing consumer applications to cope with poor quality data from real-time 3D sensors. The proposed research has broad impact potential, ranging from entertainment (e.g. video games) to medical applications (e.g. virtual surgery) to security (e.g. behaviour monitoring) among many others. Any applicative scenario requiring a computer program to efficiently represent 3D geometry could benefit from the results in our research. Simply stated, the horizons of its potential impact are aligned with those of the upcoming augmented reality revolution.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
British Columbia, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2016-05786
Name nom
Tagliasacchi, Andrea
Department département
Computer Science - Computer Science
Organization id
7
Institution établissement
University of Victoria
Province en
British Columbia
Province fr
Colombie-Britannique
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2017
Competition year année de concours
2016
Award amount
31000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
2603
Research subject group en
Robotics
Research subject group fr
Robotique
Research subject en
Computer vision
Research subject fr
Vision artificielle
Partie
2
Nb partie
5
Application title
Real-Time Modeling and Registration of Dynamic Geometry
Keyword
NSERC
Application summary
The augmented reality market is forecast to reach $120 billion by 2020. The advent of consumer-level augmented reality devices (e.g. Microsoft HoloLens) has been fuelled by technological leaps in real-time sensors capable of simultaneously capturing colour and depth (e.g. Microsoft Kinect). While these sensors provide a way of measuring the 3D geometry of the real world, processing geometry in real-time is particularly challenging. For example, many techniques only focus on specific sub-problems like face, body or hand tracking, and thus often assume the object being observed by the camera is of known geometry. Adapting these algorithms to cope with an unknown, dynamic and ever-changing environment is a fundamental challenge, especially when targeting real-time applications with their conflicting requirements of efficiency and power consumption. To face these challenges, my students and I will investigate a way to represent geometry that is different from what is typically adopted by the computer graphics and vision communities. This representation, a particular variant of the so-called convolution surfaces is used today by 3D artists to efficiently design the coarse articulated structure of digital content. Their mathematical properties make them ideal for virtual reality applications, as geometric queries essential to real-time registration algorithms (i.e. tracking) can be answered with extreme efficiency. Furthermore, these models can also be easily adapted to changes in geometry, thus making them suitable to represent our ever-changing world. My research team will approach this investigation from three different angles. We will (1) study how to reverse engineer convolution surfaces from digital and acquired data; (2) investigate their use and scalability in real-time consumer applications; and (3) develop a cost-effective omnidirectional 3D acquisition system. The latter will help us devise statistical models allowing consumer applications to cope with poor quality data from real-time 3D sensors. The proposed research has broad impact potential, ranging from entertainment (e.g. video games) to medical applications (e.g. virtual surgery) to security (e.g. behaviour monitoring) among many others. Any applicative scenario requiring a computer program to efficiently represent 3D geometry could benefit from the results in our research. Simply stated, the horizons of its potential impact are aligned with those of the upcoming augmented reality revolution.