Grant: Alliance Grants
Université Laval
$20,000.00
Learning to reason from uncalibrated wide angle images
EF 2023-24
Résumé
We witness an increasing demand of using cameras with wide field of view (FOV) lenses in many real-life applications, including security, augmented reality (AR), healthcare and autonomous systems. The increased field of view minimizes cost, energy and computation since fewer cameras are needed. The downside of using such lenses is that they require the use of lens calibration methods to obtain a lens distortion profile, which is then used to rectify the image-that is, to cancel the effects of distortion and create a perspective projection image. A wide array of such methods, ranging from classical (deterministic) to deep-learning-based have been proposed. Unfortunately, calibration is considered as a burden in most critical systems due to the many pre- and post-processing steps.In this proposal, we propose to break free from the "calibrate-and-rectify" paradigm, and instead directly reason on the wide-angle images. The goal of this project is therefore to develop a set of theoretical and experimental tools for scene understanding on images captured with uncalibrated, wide-angle lenses.
Programme
Alliance Grants
Bénéficiaire
Emplacement
Quebec, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
567654-2021
Name nom
Lalonde, Jean-François J-F
Department département
Génie électrique et génie informatique
Organization id
51
Institution établissement
Université Laval
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2023
Competition year année de concours
2021
Award amount
20000
Program id
ALLRP
Program name en
Alliance Grants
Program name fr
Subventions Alliance
Group en
RESEARCH PARTNERSHIPS
Group fr
PARTENARIATS DE RECHERCHE
Committee code
96
Committee name en
RPP Internal Decision Cttee
Committee name fr
Cté de décision interne - PPR
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
2605
Research subject group en
Robotics
Research subject group fr
Pattern analysis and machine intelligence
Research subject en
Robotique
Research subject fr
Analyse de formes et intelligence artificielle
Application title
Learning to reason from uncalibrated wide angle images
Keyword
computer vision; deep learning; depth estimation; geometric deep learning; graph convolutional neural networks; machine learning; object detection; wide-angle imagery
Application summary
We witness an increasing demand of using cameras with wide field of view (FOV) lenses in many real-life applications, including security, augmented reality (AR), healthcare and autonomous systems. The increased field of view minimizes cost, energy and computation since fewer cameras are needed. The downside of using such lenses is that they require the use of lens calibration methods to obtain a lens distortion profile, which is then used to rectify the image-that is, to cancel the effects of distortion and create a perspective projection image. A wide array of such methods, ranging from classical (deterministic) to deep-learning-based have been proposed. Unfortunately, calibration is considered as a burden in most critical systems due to the many pre- and post-processing steps.In this proposal, we propose to break free from the "calibrate-and-rectify" paradigm, and instead directly reason on the wide-angle images. The goal of this project is therefore to develop a set of theoretical and experimental tools for scene understanding on images captured with uncalibrated, wide-angle lenses.