Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Discovery Grants Program - Individual

University of Alberta

$24,000.00

Incremental modeling of geometry and appearance from video

FY 2013-14

Summary
The focus of the proposed research is representations and computational methods for intermediate structures between 2D images and 3D models. Classically image processing and feature detection has been done first on a per-2D-image basis. Then in a single batch process a 3D geometry is computed from all the 2D features. In particular we will explore:(1) Free-space constraints. Each view of a 3D surface patch implies there is a free-space volume between the camera and that surface. Integrating such volumes yields an alternate 3D modeling to the conventional triangulation. While free-space is used in robotics for 2D ground maps, it is little explored in 3D computer vision, and constructing efficient and accurate incremental 3D volume merging algorithms is challenging.(2) Proxy geometries. The assumption that a computed geometry is accurately representing the real scene is fragile (and often incorrect). In Image-Based Rendering (IBR) a branch of computer graphics, a coarse proxy geometry is used to represent (index) ray-sets. A proxy geometry can be used to index depth displacement maps[22] and appearance information as well.(3) Statistical models of texture/appearance. Much computer vision uses the color-constancy assumption -- each surface point has a color. This is not true of physical surfaces in general, but more importantly algorithms often fail because color constancy is a particularly poor assumption under inexact geometries. Statistical models of appearance are less constrained. We have pioneered the use of linear subspace models for texture [Jagersand, CVPR 1997] and continued to develop this for 3D modeling [32,37]. Algorithms for non-linear spaces and incremental computation will be explored here.(4) Multi-level models. The use of a coarse 3D geometry proxy to index a displacement map, which in turn indexes a parametrized appearance model leads to an integrated model where different information is represented at different scales: Macro, Meso and Micro.
Program
Discovery Grants Program - Individual
Location
Alberta, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
238784-2011
Name nom
Jagersand, Martin
Department département
Computing Science
Organization id
9
Institution établissement
University of Alberta
Province en
Alberta
Province fr
Alberta
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2013
Competition year année de concours
2011
Award amount
24000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
1200
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Advancement of knowledge
Area of application fr
Avancement des connaissances
Research subject code
2603
Research subject group en
Robotics
Research subject group fr
Robotique
Research subject en
Computer vision
Research subject fr
Vision artificielle
Partie
3
Nb partie
5
Application title
Incremental modeling of geometry and appearance from video
Keyword
NSERC
Application summary
The focus of the proposed research is representations and computational methods for intermediate structures between 2D images and 3D models. Classically image processing and feature detection has been done first on a per-2D-image basis. Then in a single batch process a 3D geometry is computed from all the 2D features. In particular we will explore:(1) Free-space constraints. Each view of a 3D surface patch implies there is a free-space volume between the camera and that surface. Integrating such volumes yields an alternate 3D modeling to the conventional triangulation. While free-space is used in robotics for 2D ground maps, it is little explored in 3D computer vision, and constructing efficient and accurate incremental 3D volume merging algorithms is challenging.(2) Proxy geometries. The assumption that a computed geometry is accurately representing the real scene is fragile (and often incorrect). In Image-Based Rendering (IBR) a branch of computer graphics, a coarse proxy geometry is used to represent (index) ray-sets. A proxy geometry can be used to index depth displacement maps[22] and appearance information as well.(3) Statistical models of texture/appearance. Much computer vision uses the color-constancy assumption -- each surface point has a color. This is not true of physical surfaces in general, but more importantly algorithms often fail because color constancy is a particularly poor assumption under inexact geometries. Statistical models of appearance are less constrained. We have pioneered the use of linear subspace models for texture [Jagersand, CVPR 1997] and continued to develop this for 3D modeling [32,37]. Algorithms for non-linear spaces and incremental computation will be explored here.(4) Multi-level models. The use of a coarse 3D geometry proxy to index a displacement map, which in turn indexes a parametrized appearance model leads to an integrated model where different information is represented at different scales: Macro, Meso and Micro.