Canada Spends Logo

Explorez notre analyse du budget 2026

Grant: Discovery Grants Program - Individual

Ryerson University

$28,000.00

Attention and Selection Mechanisms in Neural Networks and Computer Vision

EF 2020-21

Résumé
The proposed research is comprised of mechanisms for attention, selection, gating and routing of information in neural information processing systems including sequential solutions to visual problems. Recurrent deep learning models form the primary construct for demonstrating the value and utility of the proposed corpus of work. While deep learning models have shown considerable success on a wide range of problems, there remains a need for better characterization of their behaviour, and innovation in directions that produce solutions that are both more parsimonious and effective in addressing their objectives. To this end, this proposal encapsulates a comprehensive body of theoretical and experimental work to meet these objectives. This is achieved through two distinct but complementary pillars as a foundation: First, we propose to examine in detail recurrent gating mechanisms that control flow of information through neural hierarchies. This includes additive. multiplicative and other gating mechanisms, their relation to gain control and normalization strategies, and connections to canonical mechanisms that appear in common feed-forward networks. My research group has shown significant potential for such control mechanisms for the capabilities of deep neural networks. Second, we address the need to consider solutions to problems that include sequential or temporal identification of relevant patterns or salient regions. Vision is inherently sequential with the most palpable example of this in humans involving head and eye movements. Equally important is the dynamic nature of processing within the brain including the role of attention. To date, many problems in computer vision operate in a manner that produces pixel-wise assignments to an image in one pass. This second pillar involves careful examination of attentive selection in space, and recurrent mechanisms for information processing to facilitate processing for vision. Products of this investigations will include sequential models of gaze patterns, solution to vision problems in a sequential manner, relationships between focal processing and recurrent gating and comparison of human an machine vision solutions to spatial sampling. Each facet of this work begins with establishing basic principles of importance as a foundation while examining practical applicability in recurrent networks and also drawing connections to attention mechanisms. As a whole, the proposed research stands to provide fundamental contributions to deep learning from an architectural perspective and at the level of augmenting our understanding of information processing capabilities of neural networks. Moreover, the research extends the status quo into a broader set of sequential or temporal solutions to machine vision problems, as an alternative paradigm for problem solving and in a form amenable to active vision systems.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data

Tel que publié

Application id
RGPIN-2019-05777
Name nom
Bruce, Neil
Department département
School of Computer Science
Organization id
43
Institution établissement
Ryerson University
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2020
Competition year année de concours
2019
Award amount
28000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
1200
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Advancement of knowledge
Area of application fr
Avancement des connaissances
Research subject code
2603
Research subject group en
Robotics
Research subject group fr
Robotique
Research subject en
Computer vision
Research subject fr
Vision artificielle
Installment
inst:2-5
Partie
4
Nb partie
5
Application title
Attention and Selection Mechanisms in Neural Networks and Computer Vision
Keyword
NSERC
Application summary
The proposed research is comprised of mechanisms for attention, selection, gating and routing of information in neural information processing systems including sequential solutions to visual problems. Recurrent deep learning models form the primary construct for demonstrating the value and utility of the proposed corpus of work. While deep learning models have shown considerable success on a wide range of problems, there remains a need for better characterization of their behaviour, and innovation in directions that produce solutions that are both more parsimonious and effective in addressing their objectives. To this end, this proposal encapsulates a comprehensive body of theoretical and experimental work to meet these objectives. This is achieved through two distinct but complementary pillars as a foundation: First, we propose to examine in detail recurrent gating mechanisms that control flow of information through neural hierarchies. This includes additive. multiplicative and other gating mechanisms, their relation to gain control and normalization strategies, and connections to canonical mechanisms that appear in common feed-forward networks. My research group has shown significant potential for such control mechanisms for the capabilities of deep neural networks. Second, we address the need to consider solutions to problems that include sequential or temporal identification of relevant patterns or salient regions. Vision is inherently sequential with the most palpable example of this in humans involving head and eye movements. Equally important is the dynamic nature of processing within the brain including the role of attention. To date, many problems in computer vision operate in a manner that produces pixel-wise assignments to an image in one pass. This second pillar involves careful examination of attentive selection in space, and recurrent mechanisms for information processing to facilitate processing for vision. Products of this investigations will include sequential models of gaze patterns, solution to vision problems in a sequential manner, relationships between focal processing and recurrent gating and comparison of human an machine vision solutions to spatial sampling. Each facet of this work begins with establishing basic principles of importance as a foundation while examining practical applicability in recurrent networks and also drawing connections to attention mechanisms. As a whole, the proposed research stands to provide fundamental contributions to deep learning from an architectural perspective and at the level of augmenting our understanding of information processing capabilities of neural networks. Moreover, the research extends the status quo into a broader set of sequential or temporal solutions to machine vision problems, as an alternative paradigm for problem solving and in a form amenable to active vision systems.