Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Discovery Grants Program - Individual

McGill University

$24,000.00

Visual Computation of Scene Layout

FY 2024-25

Summary
A fundamental challenge of 3D visual perception is that we observe the world from our own self-centered viewpoint, and yet we wish to know how the world actually is, unbiased by our viewpoint. My long term research objective is to show how human and computer vision systems are able to perceive the 3D geometry of the world, from information in various visual cues. I specifically try to identify novel visual cues and develop computational models based on them. My short term objective is to address the case of landscape-like scenes. Many human vision studies have shown that 3D space perception in outdoor scenes suffers from systematic biases: large distances appear spatially compressed, and sloped surfaces such as hills and valleys appear steeper than they are. Deep learning based computer vision systems for estimating depth also have biases, depending on the data they are trained on. In this proposed research, we will examine how well human observers and computer vision systems can estimate spatial layout; specifically we will examine a neglected scenario of landscape-like scenes in which the `ground plane' is non-planar. For the human vision studies, we will use virtual reality displays to measure human perception of depth and ground plane slope. We will generalize methodologies used in many previous studies which have nearly all examined the case of planar ground planes. For the computer vision studies, we will use existing deep neural network-based depth estimation methods, and measure bias and uncertainty in estimated depth. By comparing human and computer vision performance, we hope to better understand what information both types of vision systems are using. Trainees will acquire a range of skills, including how to do user studies, how to use VR displays, and how to use deep learning computer vision methods to estimate scene layout. This will give them the expertise needed to enter emerging fields, such as VR content creation, and vision systems for self-driving cars.
Program
Discovery Grants Program - Individual
Location
Quebec, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
RGPIN-2022-03489
Name nom
Langer, Michael
Department département
School of Computer Science
Organization id
61
Institution établissement
McGill University
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2024
Competition year année de concours
2022
Award amount
24000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
1210
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Psychology
Area of application fr
Psychologie
Research subject code
2605
Research subject group en
Robotics
Research subject group fr
Robotique
Research subject en
Pattern analysis and machine intelligence
Research subject fr
Analyse de formes et intelligence artificielle
Field of research list names en
Not available
Field of research list names fr
Non disponible
Socioeconomic objective list names en
Not available
Socioeconomic objective list names fr
Non disponible
Application title
Visual Computation of Scene Layout
Keywords
3d vision; deep learning; virtual reality; depth perception; computer vision; landscape
Application summary
A fundamental challenge of 3D visual perception is that we observe the world from our own self-centered viewpoint, and yet we wish to know how the world actually is, unbiased by our viewpoint. My long term research objective is to show how human and computer vision systems are able to perceive the 3D geometry of the world, from information in various visual cues. I specifically try to identify novel visual cues and develop computational models based on them. My short term objective is to address the case of landscape-like scenes. Many human vision studies have shown that 3D space perception in outdoor scenes suffers from systematic biases: large distances appear spatially compressed, and sloped surfaces such as hills and valleys appear steeper than they are. Deep learning based computer vision systems for estimating depth also have biases, depending on the data they are trained on. In this proposed research, we will examine how well human observers and computer vision systems can estimate spatial layout; specifically we will examine a neglected scenario of landscape-like scenes in which the `ground plane' is non-planar. For the human vision studies, we will use virtual reality displays to measure human perception of depth and ground plane slope. We will generalize methodologies used in many previous studies which have nearly all examined the case of planar ground planes. For the computer vision studies, we will use existing deep neural network-based depth estimation methods, and measure bias and uncertainty in estimated depth. By comparing human and computer vision performance, we hope to better understand what information both types of vision systems are using. Trainees will acquire a range of skills, including how to do user studies, how to use VR displays, and how to use deep learning computer vision methods to estimate scene layout. This will give them the expertise needed to enter emerging fields, such as VR content creation, and vision systems for self-driving cars.