Grant: Discovery Grants Program - Individual
École de technologie supérieure
$26,000.00
Adaptive Context-Based Systems for Face Recognition in Video Surveillance
EF 2019-20
Résumé
Still-to-video face recognition (FR) is an important function in video surveillance, where faces captured across a network of video cameras are matched against reference stills images. Currently, the performance of state-of-the-art systems is severely affected by the multiple non-stationary operational environments, defined by variations in, e.g., pose, illumination and camera viewpoint. Moreover, since an individual is typically enrolled using one or few reference stills captured during enrolment, face models are often poor representatives of the faces to be recognized during operations. ***The main objective of this research program is to investigate and develop new still-to-video FR systems for accurate spatio-temporal recognition of individuals of interest across multiple cameras. To compensate for the limited number of labeled reference stills available during enrolment, the system's facial models will adapt based on contextual information from its operational domain (Od) in order to sustain a high level of performance. In particular, this research relies on a bank of unlabeled (non-target) video trajectories from each different camera in a surveillance network. For each Od, this these systems will allow to: (1) model the distribution of capture conditions in facial trajectories according to feature and ROI quality spaces, (2) generate accurate detectors for each enrolled individual using instance- and feature-based methods for domain adaptation, (3) generate synthetic reference ROIs, (4) weight and integrate the response of each detector according to capture condition, and (5) perform efficient self-update of detectors driven by changes in capture conditions. This program is organized according to 3 axes: ***1. Modeling the capture conditions densities from Od trajectories.***2. Dynamic ensembles of exemplar SVMs that exploit domain adaptation for accurate detection of individuals. New techniques will be developed to assess classifier competence, self-update, and generate synthetic stills.***3. Extended sparse representation classifiers that use domain adaptation for accurate detection of individuals. New techniques will be developed to compress, synthetically generate, and specialize dictionaries to an Od.***Innovative techniques developed in this program will contribute to the emergence of context-sensitive FR technologies for watchlist screening, and for several other visual monitoring and recognition applications. As such, this research will remain relevant in the areas of pattern recognition, evolutionary computing and computer vision. Although government, military and law enforcement remain the principal users of video surveillance technologies, the recent emergence of many commercial applications and consumer devices will also offer excellent opportunities for partnering with companies, training HQP, and encourage future grant applications.**
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Quebec, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2016-06783
Name nom
Granger, Eric
Department département
Génie de la production automatisée
Organization id
53
Institution établissement
École de technologie supérieure
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2019
Competition year année de concours
2016
Award amount
26000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2805
Research subject group en
Artificial intelligence
Research subject group fr
Intelligence artificielle
Research subject en
Learning and inference theories
Research subject fr
Théories de l'apprentissage et l'inférence
Installment
inst:4 - 5
Partie
4
Nb partie
5
Application title
Adaptive Context-Based Systems for Face Recognition in Video Surveillance
Keyword
NSERC
Application summary
Still-to-video face recognition (FR) is an important function in video surveillance, where faces captured across a network of video cameras are matched against reference stills images. Currently, the performance of state-of-the-art systems is severely affected by the multiple non-stationary operational environments, defined by variations in, e.g., pose, illumination and camera viewpoint. Moreover, since an individual is typically enrolled using one or few reference stills captured during enrolment, face models are often poor representatives of the faces to be recognized during operations. ***The main objective of this research program is to investigate and develop new still-to-video FR systems for accurate spatio-temporal recognition of individuals of interest across multiple cameras. To compensate for the limited number of labeled reference stills available during enrolment, the system's facial models will adapt based on contextual information from its operational domain (Od) in order to sustain a high level of performance. In particular, this research relies on a bank of unlabeled (non-target) video trajectories from each different camera in a surveillance network. For each Od, this these systems will allow to: (1) model the distribution of capture conditions in facial trajectories according to feature and ROI quality spaces, (2) generate accurate detectors for each enrolled individual using instance- and feature-based methods for domain adaptation, (3) generate synthetic reference ROIs, (4) weight and integrate the response of each detector according to capture condition, and (5) perform efficient self-update of detectors driven by changes in capture conditions. This program is organized according to 3 axes: ***1. Modeling the capture conditions densities from Od trajectories.***2. Dynamic ensembles of exemplar SVMs that exploit domain adaptation for accurate detection of individuals. New techniques will be developed to assess classifier competence, self-update, and generate synthetic stills.***3. Extended sparse representation classifiers that use domain adaptation for accurate detection of individuals. New techniques will be developed to compress, synthetically generate, and specialize dictionaries to an Od.***Innovative techniques developed in this program will contribute to the emergence of context-sensitive FR technologies for watchlist screening, and for several other visual monitoring and recognition applications. As such, this research will remain relevant in the areas of pattern recognition, evolutionary computing and computer vision. Although government, military and law enforcement remain the principal users of video surveillance technologies, the recent emergence of many commercial applications and consumer devices will also offer excellent opportunities for partnering with companies, training HQP, and encourage future grant applications.**