Grant: Discovery Grants Program - Individual
McGill University
$26,000.00
Computational Perception of Surface Material and 3D Spatial Layout
EF 2017-18
Résumé
A fundamental task in visual perception is to estimate the spatial layout of a scene, for example, the slope of the ground terrain on which the observer can move and the positions of any obstacles such an objects or walls. Standard computational models for solving this layout estimation problem have concentrated on scenes that have matte reflectance, but scenes with glossy reflecting surfaces have received relatively little attention. Important examples include navigating outdoor street scenes in the rain at night, which is challenging because such scenes are dominated by specular highlights from street lamps and car head lamps. Other scene examples with glossy surfaces include lake or ocean surfaces that are viewed from a boat or from a low flying aerial vehicle, or indoor scenes with polished floors, glossy painted or glass walls, or windows. This research will address how to interpret the specular highlights and mirror reflections that arise from large near-planar glossy surfaces. The approach will be highly interdisciplinary, addressing problem in robotic vision, human visual perception, and applied perception in computer graphics. A key goal in the applied perception problems in particular is to understand how well people perceive layout of glossy planar surfaces in virtual environments that are viewed using binocular, head-tracked, wide field of view displays such as the Oculus Rift. Such displays yield remarkable immersion effects, and it is likely that they will revolutionize how we experience real and virtual worlds. This research should provide insight into the strengths and limitations of these displays for conveying spatial layout and material information about glossy scenes.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Quebec, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2016-03650
Name nom
Langer, Michael
Department département
Computer Science, School of - Computer Science, School of
Organization id
61
Institution établissement
McGill University
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2017
Competition year année de concours
2016
Award amount
26000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
801
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Computer software
Area of application fr
Logiciel
Research subject code
2603
Research subject group en
Robotics
Research subject group fr
Robotique
Research subject en
Computer vision
Research subject fr
Vision artificielle
Partie
2
Nb partie
5
Application title
Computational Perception of Surface Material and 3D Spatial Layout
Keyword
NSERC
Application summary
A fundamental task in visual perception is to estimate the spatial layout of a scene, for example, the slope of the ground terrain on which the observer can move and the positions of any obstacles such an objects or walls. Standard computational models for solving this layout estimation problem have concentrated on scenes that have matte reflectance, but scenes with glossy reflecting surfaces have received relatively little attention. Important examples include navigating outdoor street scenes in the rain at night, which is challenging because such scenes are dominated by specular highlights from street lamps and car head lamps. Other scene examples with glossy surfaces include lake or ocean surfaces that are viewed from a boat or from a low flying aerial vehicle, or indoor scenes with polished floors, glossy painted or glass walls, or windows. This research will address how to interpret the specular highlights and mirror reflections that arise from large near-planar glossy surfaces. The approach will be highly interdisciplinary, addressing problem in robotic vision, human visual perception, and applied perception in computer graphics. A key goal in the applied perception problems in particular is to understand how well people perceive layout of glossy planar surfaces in virtual environments that are viewed using binocular, head-tracked, wide field of view displays such as the Oculus Rift. Such displays yield remarkable immersion effects, and it is likely that they will revolutionize how we experience real and virtual worlds. This research should provide insight into the strengths and limitations of these displays for conveying spatial layout and material information about glossy scenes.