Canada Spends Logo

Explorez notre analyse du budget 2026

Grant: Alliance Grants

Université Laval

$24,350.00

Learning to light and relight images

EF 2022-23

Résumé
Augmented reality is the process of combining the virtual with the real. For the combination to look realistic, the virtual content must match the real: their orientation, lighting, and presence in the scene must all match the real-world conditions. Achieving highly realistic effects is possible (as demonstrated on a regular basis in blockbuster movies), but doing so requires tremendous amounts of manpower---indeed, all special effects nowadays require tens, if not hundreds, of skilled artists painstakingly working on each shot. In this proposal, we aim at taking a step towards automating the process of realistically inserting virtual objects into real photographs. Specifically, we address the problem of lighting estimation along the following two main axes. First, we will demonstrate that the full, spatially-varying lighting conditions of a scene can be robustly estimated from either a single, or multiple images of that scene. Second, we will show how images of objects and even full scenes can be interactively relit according to a target lighting.
Programme
Alliance Grants
Bénéficiaire
Emplacement
Quebec, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data

Tel que publié

Application id
557208-2020
Name nom
Lalonde, Jean-François JF
Department département
Génie électrique et génie informatique
Organization id
51
Institution établissement
Université Laval
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2022
Competition year année de concours
2020
Award amount
24350
Program id
ALLRP
Program name en
Alliance Grants
Program name fr
Subventions Alliance
Group en
RESEARCH PARTNERSHIPS
Group fr
PARTENARIATS DE RECHERCHE
Committee code
96
Committee name en
RPP Internal Decision Cttee
Committee name fr
Cté de décision interne - PPR
Area of application code
9999
Area of application group en
Not available
Area of application group fr
Non disponible
Area of application en
Not available
Area of application fr
Non disponible
Research subject code
2603
Research subject group en
Robotics
Research subject group fr
Robotique
Research subject en
Computer vision
Research subject fr
Vision artificielle
Installment
inst:3
Partie
1
Nb partie
3
Application title
Learning to light and relight images
Application summary
Augmented reality is the process of combining the virtual with the real. For the combination to look realistic, the virtual content must match the real: their orientation, lighting, and presence in the scene must all match the real-world conditions. Achieving highly realistic effects is possible (as demonstrated on a regular basis in blockbuster movies), but doing so requires tremendous amounts of manpower---indeed, all special effects nowadays require tens, if not hundreds, of skilled artists painstakingly working on each shot. In this proposal, we aim at taking a step towards automating the process of realistically inserting virtual objects into real photographs. Specifically, we address the problem of lighting estimation along the following two main axes. First, we will demonstrate that the full, spatially-varying lighting conditions of a scene can be robustly estimated from either a single, or multiple images of that scene. Second, we will show how images of objects and even full scenes can be interactively relit according to a target lighting.