Grant: Discovery Grants Program - Individual
University of Toronto
$94,000.00
Transport-Aware Imaging for Computer Vision
EF 2020-21
Résumé
The main goal of my research program for the next five years will be to study, design, and use a new class of computational cameras whose key property is that they are "transport-aware." Unlike conventional cameras which record all incident light, transport-aware cameras can be programmed to block some of that light, based on the actual 3D paths it followed through a scene. Transport-aware cameras use a programmable light source for illumination and a programmable sensor mask for imaging, and were pioneered by my research group three years ago.
Live video from a transport-aware camera can offer a very unconventional view of our everyday world in which refraction and scattering can be selectively blocked or enhanced, visual structures too subtle to notice with the naked eye can become apparent, and object surfaces can be reconstructed in 3D under challenging conditions well beyond the state of the art. Our initial work on harnessing their power brings together computer vision, computer graphics, numerical optimization and geometric optics to demonstrate never-seen-before capabilities with potential applications in 3D shape acquisition; robust time-of-flight imaging; visual material analysis; scene understanding; robotic navigation; industrial inspection; and medical/scientific imaging among others.
Our program seeks to unlock the full potential of these cameras by (1) generalizing the concept of transport-aware imaging and advancing its mathematical underpinnings; (2) designing and building novel transport-aware camera systems; and (3) exploiting these newfound sources of visual input to solve challenging 3D and 2D visual inference tasks.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2016-06124
Name nom
Kutulakos, Kiriakos
Department département
Computer Science
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2020
Competition year année de concours
2016
Award amount
94000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2603
Research subject group en
Robotics
Research subject group fr
Robotique
Research subject en
Computer vision
Research subject fr
Vision artificielle
Installment
inst:5-6
Partie
2
Nb partie
6
Application title
Transport-Aware Imaging for Computer Vision
Keyword
NSERC
Application summary
The main goal of my research program for the next five years will be to study, design, and use a new class of computational cameras whose key property is that they are "transport-aware." Unlike conventional cameras which record all incident light, transport-aware cameras can be programmed to block some of that light, based on the actual 3D paths it followed through a scene. Transport-aware cameras use a programmable light source for illumination and a programmable sensor mask for imaging, and were pioneered by my research group three years ago.
Live video from a transport-aware camera can offer a very unconventional view of our everyday world in which refraction and scattering can be selectively blocked or enhanced, visual structures too subtle to notice with the naked eye can become apparent, and object surfaces can be reconstructed in 3D under challenging conditions well beyond the state of the art. Our initial work on harnessing their power brings together computer vision, computer graphics, numerical optimization and geometric optics to demonstrate never-seen-before capabilities with potential applications in 3D shape acquisition; robust time-of-flight imaging; visual material analysis; scene understanding; robotic navigation; industrial inspection; and medical/scientific imaging among others.
Our program seeks to unlock the full potential of these cameras by (1) generalizing the concept of transport-aware imaging and advancing its mathematical underpinnings; (2) designing and building novel transport-aware camera systems; and (3) exploiting these newfound sources of visual input to solve challenging 3D and 2D visual inference tasks.