Grant: Collaborative Research and Development Grants
École de technologie supérieure
$70,000.00
Deep Domain Adaptation and Fusion for Person Recognition in the Wild
FY 2021-22
Summary
Nuvoola Inc. is a Canadian company that provides cloud managed services and solutions based on artificial intelligence. It seeks to develop software for tracking the location of individuals appearing in real-world video surveillance environments. In particular, Nuvoola seeks to develop accurate person re-identification (Re-ID) systems that allow recognizing a same person of interest appearing over time, and across multiple distributed cameras. Re-ID is a challenging problem because of variations in capture conditions, e.g., cameras viewpoint, pose, illumination, scale, motion blur, background, occlusion. State-of-the-art systems for Re-ID employ deep Siamese networks for matching, yet these deep models require supervised training on a large and diverse amount of labeled data to achieve a high level of accuracy and robustness. For real-world applications, however, Re-ID accuracy can decline if there is a considerable divergence between the capture conditions of development and operational environments. The first objective of this project is to investigate and develop deep learning architectures that are suitable for accurate domain adaptation (DA) of deep Siamese networks in real-world applications by learning domain-invariant representations. Some techniques in literature are relevant for this project but provide limited versatility and improvements on real-world Re-ID videos, where domain shifts are significant. The second objective is to investigate and develop specialized deep learning models for information fusion, and in particular on multi-modal, spatiotemporal, and context-based fusion. This project involves a cross-disciplinary team from ETS and Nuvoola Inc., and will allow to intensify the exchange of ideas and resources, and establish long-term collaborative links. Focusing on the design of deep learning models for visual recognition applications from large and mostly unlabeled datasets, this project will focus on state-of-the-art research. Significant findings of this research project will be disseminated in high caliber scientific journals and conferences and exploited in Nuvoola video analytics applications. It also allows training of highly qualified personnel to face current and future challenges in areas of strategic interest.
Program
Collaborative Research and Development Grants
Recipient
Location
Quebec, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
543663-2019
Name nom
Granger, Eric
Department département
Génie des systèmes
Organization id
53
Institution établissement
École de technologie supérieure
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2021
Competition year année de concours
2019
Award amount
70000
Program id
CRDPJ
Program name en
Collaborative Research and Development Grants
Program name fr
Subventions de recherche et développement coopérative
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
96
Committee name en
RPP Internal Decision Cttee
Committee name fr
Cté de décision interne - PPR
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
2605
Research subject group en
Robotics
Research subject group fr
Robotique
Research subject en
Pattern analysis and machine intelligence
Research subject fr
Analyse de formes et intelligence artificielle
Installment
inst:4
Partie
1
Nb partie
4
Application title
Deep Domain Adaptation and Fusion for Person Recognition in the Wild
Keyword
NSERC
Application summary
Nuvoola Inc. is a Canadian company that provides cloud managed services and solutions based on artificial intelligence. It seeks to develop software for tracking the location of individuals appearing in real-world video surveillance environments. In particular, Nuvoola seeks to develop accurate person re-identification (Re-ID) systems that allow recognizing a same person of interest appearing over time, and across multiple distributed cameras. Re-ID is a challenging problem because of variations in capture conditions, e.g., cameras viewpoint, pose, illumination, scale, motion blur, background, occlusion. State-of-the-art systems for Re-ID employ deep Siamese networks for matching, yet these deep models require supervised training on a large and diverse amount of labeled data to achieve a high level of accuracy and robustness. For real-world applications, however, Re-ID accuracy can decline if there is a considerable divergence between the capture conditions of development and operational environments. The first objective of this project is to investigate and develop deep learning architectures that are suitable for accurate domain adaptation (DA) of deep Siamese networks in real-world applications by learning domain-invariant representations. Some techniques in literature are relevant for this project but provide limited versatility and improvements on real-world Re-ID videos, where domain shifts are significant. The second objective is to investigate and develop specialized deep learning models for information fusion, and in particular on multi-modal, spatiotemporal, and context-based fusion. This project involves a cross-disciplinary team from ETS and Nuvoola Inc., and will allow to intensify the exchange of ideas and resources, and establish long-term collaborative links. Focusing on the design of deep learning models for visual recognition applications from large and mostly unlabeled datasets, this project will focus on state-of-the-art research. Significant findings of this research project will be disseminated in high caliber scientific journals and conferences and exploited in Nuvoola video analytics applications. It also allows training of highly qualified personnel to face current and future challenges in areas of strategic interest.