Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Discovery Grants Program - Individual

The University of British Columbia

$33,000.00

Advancing Object Detection and Tracking Frontiers in Intelligent Vision-Based Applications

FY 2024-25

Summary
Object detection and tracking (ODT) is considered a cornerstone in most intelligent vision-based applications. We define object detection as the broad research area that identifies the presence of objects of certain classes (the well-known Classification task) and localizes their position. Object tracking identifies the trajectories of the same objects over time in a video or a sequence of images. The intelligent vision-based applications market is expected to grow from $12.2 billion in 2021 to $20.5 billion in 2027. Many domains rely on these intelligent vision-based applications, including drone vision, intelligent video surveillance, autonomous driving, medical and health applications, and security. Recently, state-of-the-art ODT models have achieved great success using supervised learning with the aid of massive labelled training datasets, even surpassing human-level performance in some cases (e.g. classification on ImageNet). However, these models are still limited in terms of the scope of the problems they can solve, and they need to "increase their out-of-domain robustness." In other words, they perform well on the specialized tasks in the specific domains they have been trained on (in-distribution), but when a domain shift happens, they "are often brittle outside of the narrow domain or scope they have been trained on," as noted in a recent July 2021 article by the Turing Award winners Bengio, LeCun, and Hinton. Adapting to domain shifts is natural to humans but is still a massive challenge for intelligent vision-based applications. A recent tragic real-life example is a March 2018 fatal collision resulting from the vision system of a self-driving car miss-classifying a pedestrian for whole six seconds during the night as different classes of objects moving at different speeds in different frames (unknown object, then as a vehicle, and finally as a bicycle). Hence, it is critical for ODT performance to be both highly accurate and consistent under different scenarios and shifts. In doing so, this will help us to progress towards developing reliable, intelligent systems that can learn and adapt much like humans. The long-term objective of this research program is to advance intelligent vision-based applications through developing and creating the next-generation object detection and tracking models. More specifically, in the short term, over the next five years, I will address the following two themes: 1) developing new techniques for domain generalization in object detection and 2) developing new techniques for robust cross-domain appearance models in object tracking. This research program will provide training to at least 13 HQP, helping them build strong backgrounds in advanced topics in image processing, computer vision, deep learning, optimization, and computational complexity analysis.
Program
Discovery Grants Program - Individual
Location
British Columbia, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
RGPIN-2022-03015
Name nom
Shehata, Mohamed
Department département
Irving K. Barber School of Arts & Science
Organization id
2
Institution établissement
The University of British Columbia
Province en
British Columbia
Province fr
Colombie-Britannique
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2024
Competition year année de concours
2022
Award amount
33000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1510
Committee name en
Electrical and Computer Engineering
Committee name fr
Génie électrique et informatique
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
2708
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Image processing
Research subject fr
Traitement des images
Field of research list names en
Not available
Field of research list names fr
Non disponible
Socioeconomic objective list names en
Not available
Socioeconomic objective list names fr
Non disponible
Application title
Advancing Object Detection and Tracking Frontiers in Intelligent Vision-Based Applications
Keywords
image and video processing; computer vision; deep learning models; imaging systems; biomedical image analysis; object detection and tracking; robust representation learning; loss function optimization
Application summary
Object detection and tracking (ODT) is considered a cornerstone in most intelligent vision-based applications. We define object detection as the broad research area that identifies the presence of objects of certain classes (the well-known Classification task) and localizes their position. Object tracking identifies the trajectories of the same objects over time in a video or a sequence of images. The intelligent vision-based applications market is expected to grow from $12.2 billion in 2021 to $20.5 billion in 2027. Many domains rely on these intelligent vision-based applications, including drone vision, intelligent video surveillance, autonomous driving, medical and health applications, and security. Recently, state-of-the-art ODT models have achieved great success using supervised learning with the aid of massive labelled training datasets, even surpassing human-level performance in some cases (e.g. classification on ImageNet). However, these models are still limited in terms of the scope of the problems they can solve, and they need to "increase their out-of-domain robustness." In other words, they perform well on the specialized tasks in the specific domains they have been trained on (in-distribution), but when a domain shift happens, they "are often brittle outside of the narrow domain or scope they have been trained on," as noted in a recent July 2021 article by the Turing Award winners Bengio, LeCun, and Hinton. Adapting to domain shifts is natural to humans but is still a massive challenge for intelligent vision-based applications. A recent tragic real-life example is a March 2018 fatal collision resulting from the vision system of a self-driving car miss-classifying a pedestrian for whole six seconds during the night as different classes of objects moving at different speeds in different frames (unknown object, then as a vehicle, and finally as a bicycle). Hence, it is critical for ODT performance to be both highly accurate and consistent under different scenarios and shifts. In doing so, this will help us to progress towards developing reliable, intelligent systems that can learn and adapt much like humans. The long-term objective of this research program is to advance intelligent vision-based applications through developing and creating the next-generation object detection and tracking models. More specifically, in the short term, over the next five years, I will address the following two themes: 1) developing new techniques for domain generalization in object detection and 2) developing new techniques for robust cross-domain appearance models in object tracking. This research program will provide training to at least 13 HQP, helping them build strong backgrounds in advanced topics in image processing, computer vision, deep learning, optimization, and computational complexity analysis.