Grant: Research Tools and Instruments
University of Toronto
$148,509.00
Programmable Camera Systems for Transport-Aware Imaging
FY 2017-18
Summary
While the last decade has seen a major race to improve the resolution, optics and noise properties of cameras, the future will likely hinge on what else a camera can offer. In the past five years at the University of Toronto, we have been exploring a new class of computational cameras whose key property is that they are ""transport-aware."" Unlike conventional cameras which record all incident light, transport-aware cameras can be programmed to block some of that light, based on the actual 3D paths it followed through a scene. Our initial work on harnessing the power of these cameras has demonstrated never-seen-before capabilities with applications to rapid 3D shape acquisition; robust time-of-flight imaging; visual material analysis; scene understanding; robotic and/or automotive navigation; industrial inspection; and even monitoring a city's electrical grid. Encouraged by these successes, we propose to build an experimental testbed that aims to push transport-aware cameras to an entirely new level of imaging flexibility, accuracy, image quality, light efficiency, portability, and ease of use. Specifically, we seek funds to fabricate transport-aware cameras completely from the ground up: by custom-fabricating their CMOS imager---along with its associated electronics---and combining it with off-the-shelf optics and programmable light sources. Our planned camera systems will act as a veritable ""swiss army knife"" for computational imaging: they will eliminate the bulky and aberration-inducing optics of existing computational imaging systems (e.g, digital micro-mirror devices, relay optics, etc) and will offer a degree of programmability that cannot be matched by any existing off-the-shelf camera. As such, they will enable the exploration of a computational camera design space for computer vision and photography applications that has so far been out of reach due to the limitations of existing imaging hardware.
Program
Research Tools and Instruments
Recipient
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
RTI-2018-00762
Name nom
Kutulakos, Kiriakos
Department département
Computer Science (St. George Campus) - Computer Science (St. George Campus)
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2017
Competition year année de concours
2018
Award amount
148509
Program id
RTI
Program name en
Research Tools and Instruments
Program name fr
Outils et instruments de recherche
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1607
Committee name en
Computer, Mathematical and Statistical Sciences (RTI)
Committee name fr
Sciences informatiques, mathématiques et statistiques (OIR)
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
2603
Research subject group en
Robotics
Research subject group fr
Robotique
Research subject en
Computer vision
Research subject fr
Vision artificielle
Partie
1
Nb partie
1
Application title
Programmable Camera Systems for Transport-Aware Imaging
Keyword
NSERC
Application summary
While the last decade has seen a major race to improve the resolution, optics and noise properties of cameras, the future will likely hinge on what else a camera can offer. In the past five years at the University of Toronto, we have been exploring a new class of computational cameras whose key property is that they are ""transport-aware."" Unlike conventional cameras which record all incident light, transport-aware cameras can be programmed to block some of that light, based on the actual 3D paths it followed through a scene. Our initial work on harnessing the power of these cameras has demonstrated never-seen-before capabilities with applications to rapid 3D shape acquisition; robust time-of-flight imaging; visual material analysis; scene understanding; robotic and/or automotive navigation; industrial inspection; and even monitoring a city's electrical grid. Encouraged by these successes, we propose to build an experimental testbed that aims to push transport-aware cameras to an entirely new level of imaging flexibility, accuracy, image quality, light efficiency, portability, and ease of use. Specifically, we seek funds to fabricate transport-aware cameras completely from the ground up: by custom-fabricating their CMOS imager---along with its associated electronics---and combining it with off-the-shelf optics and programmable light sources. Our planned camera systems will act as a veritable ""swiss army knife"" for computational imaging: they will eliminate the bulky and aberration-inducing optics of existing computational imaging systems (e.g, digital micro-mirror devices, relay optics, etc) and will offer a degree of programmability that cannot be matched by any existing off-the-shelf camera. As such, they will enable the exploration of a computational camera design space for computer vision and photography applications that has so far been out of reach due to the limitations of existing imaging hardware.