Grant: Canada Research Chairs
York University
$25,000.00
Computational Neuroscience
FY 2023-24
Summary
Computer vision has been revolutionized by the development of convolutional neural network (CNN) models that were inspired by the way the human brain processes visual information. These same CNN models have set the current state-of-the-art at predicting visually evoked neural activity in the retina and the brain’s visual cortex, and recent work from Zylberberg and colleagues demonstrated that training CNN models to mimic the brain’s visually evoked neural activity patterns causes those models to perform better at object recognition tasks. This body of research emphasizes that improved computational models of the visual system drive advances in both visual neuroscience and computer vision. Despite these advances, current computational models of the visual system are limited in their ability to predict neural activity in new (previously unseen) individuals, and they fail to predict visually evoked neural activity under variable lighting conditions such as those that people experience when driving through the city on a sunny day. Dr. Zylberberg’s research program aims to overcome these limitations by applying new approaches from artificial intelligence (AI) known as foundation model approaches, and by incorporating into deep learning models more bio-realistic components that adapt to changing lighting conditions the same way the visual system does. Finally, Dr. Zylberberg will apply the improvements in visual system modeling that result from this research to his ongoing efforts to use neural data to develop better computer vision systems. Altogether, this research program will improve computational visual system models for application in both neuroscience and computer vision.
Program
Canada Research Chairs
Recipient
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
CRC-2022-00277
Name nom
Zylberberg, Joel
Department département
Physics and Astronomy - York University
Organization id
38
Institution établissement
York University
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2023
Competition year année de concours
2022
Award amount
25000
Program id
CRC
Program name en
Canada Research Chairs
Program name fr
Chaires de recherche du Canada
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
9998
Committee name en
Canada Research Chair Selection Committee
Committee name fr
Comité de sélection des Chaires de recherche du Canada
Area of application code
10000
Area of application group en
The socioeconomic objective available
Area of application group fr
L'objectif socioéconomique disponible
Area of application en
The socioeconomic objective available
Area of application fr
L'objectif socioéconomique disponible
Research subject code
10000
Research subject group en
The field of research available
Research subject group fr
The field of research available
Research subject en
Le domaine de recherche disponible
Research subject fr
Le domaine de recherche disponible
Field of research list codes
RDF1061007
Field of research list names en
Invertebrate biology (except insect biology)
Field of research list names fr
Biologie des invertébrés (sauf la biologie des insectes)
Socioeconomic objective list codes
RDS10610
Socioeconomic objective list names en
Information systems, technologies and services
Socioeconomic objective list names fr
Systèmes, technologies et services d'information
Application title
Computational Neuroscience
Keyword
Neuroscience; Vision; Machine Learning; Artificial Intelligence; Cortical Networks; Biophysics
Application summary
Computer vision has been revolutionized by the development of convolutional neural network (CNN) models that were inspired by the way the human brain processes visual information. These same CNN models have set the current state-of-the-art at predicting visually evoked neural activity in the retina and the brain’s visual cortex, and recent work from Zylberberg and colleagues demonstrated that training CNN models to mimic the brain’s visually evoked neural activity patterns causes those models to perform better at object recognition tasks. This body of research emphasizes that improved computational models of the visual system drive advances in both visual neuroscience and computer vision. Despite these advances, current computational models of the visual system are limited in their ability to predict neural activity in new (previously unseen) individuals, and they fail to predict visually evoked neural activity under variable lighting conditions such as those that people experience when driving through the city on a sunny day. Dr. Zylberberg’s research program aims to overcome these limitations by applying new approaches from artificial intelligence (AI) known as foundation model approaches, and by incorporating into deep learning models more bio-realistic components that adapt to changing lighting conditions the same way the visual system does. Finally, Dr. Zylberberg will apply the improvements in visual system modeling that result from this research to his ongoing efforts to use neural data to develop better computer vision systems. Altogether, this research program will improve computational visual system models for application in both neuroscience and computer vision.