Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Discovery Grants Program - Individual

McGill University

$62,200.00

Credit assignment in the neocortex

FY 2024-25

Summary
When we learn something new our brain changes. Specifically, the connections between the cells in our brains change. These connections, called synapses, determine how information flows through our brains, so changing them alters how our nervous system processes information. What is notable about learning, though, is that we don't just change when we learn, we get better. Though neuroscientists now have some understanding about synaptic changes in the brain, the mechanisms that ensure that we actually get better at something when we learn remain very mysterious. This mystery is known as the credit assignment problem. Somehow, our brains are capable of "assigning credit" for any errors or successes to the synapses that underlie a behaviour. Put another way, our brain somehow knows which synapses need to change in order to reduce our errors and increase our successes. Interestingly, simulated brains, known as artificial neural networks, have allowed researchers in the field of artificial intelligence (AI) to build systems that can recognise images, translate languages, drive cars, and control robotic arms. As with real brains, artificial neural networks change their synaptic connections when they learn. This works because computer scientists have developed algorithms for assigning credit in artificial neural networks. However, artificial neural networks still cannot learn as well as human beings. For example, a human can learn to drive a car in a matter of hours, whereas current artificial neural networks take millions of hours. Therefore, though the credit assignment algorithms used in artificial neural networks have been important for AI, they do not tell us exactly how our own brains work. The question we want to answer in this research program is: how does the mammalian brain solve the credit assignment problem, and can we build artificial neural networks that mimic the brain's solution? We will utilise a combination of AI and neuroscience to address this question. This research has significant potential to benefit society. If we could understand how the brain solves the credit assignment problem, then we could simultaneously make two significant leaps forward. First, we would understand how the brain rewires itself when learning. This could help us to develop novel brain-computer interfaces, prosthetic devices, etc. Second, if we understood credit assignment in the brain, we could potentially develop new algorithms for artificial neural networks that would give them the ability to learn more like humans. This could make them faster at learning. Canada is a world-leader in neuroscience inspired AI, and this research will help to train the next generation of researchers, software engineers, and entrepreneurs to help consolidate our position in this field and generate economic benefits for Canadian society.
Program
Discovery Grants Program - Individual
Location
Quebec, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
RGPIN-2020-05105
Name nom
Richards, Blake
Department département
Biological Sciences (Scarborough) - Biological Sciences (Scarborough)
Organization id
61
Institution établissement
McGill University
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2024
Competition year année de concours
2020
Award amount
62200
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1502
Committee name en
Biological Systems and Functions
Committee name fr
Systèmes et fonctions biologiques
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2805
Research subject group en
Artificial intelligence
Research subject group fr
Intelligence artificielle
Research subject en
Learning and inference theories
Research subject fr
Théories de l'apprentissage et l'inférence
Field of research list names en
Not available
Field of research list names fr
Non disponible
Socioeconomic objective list names en
Not available
Socioeconomic objective list names fr
Non disponible
Application title
Credit assignment in the neocortex
Keywords
learning algorithms; synaptic plasticity; neocortex; machine learning; gradient descent; computational modelling; 2-photon imaging; sensorimotor learning
Application summary
When we learn something new our brain changes. Specifically, the connections between the cells in our brains change. These connections, called synapses, determine how information flows through our brains, so changing them alters how our nervous system processes information. What is notable about learning, though, is that we don't just change when we learn, we get better. Though neuroscientists now have some understanding about synaptic changes in the brain, the mechanisms that ensure that we actually get better at something when we learn remain very mysterious. This mystery is known as the credit assignment problem. Somehow, our brains are capable of "assigning credit" for any errors or successes to the synapses that underlie a behaviour. Put another way, our brain somehow knows which synapses need to change in order to reduce our errors and increase our successes. Interestingly, simulated brains, known as artificial neural networks, have allowed researchers in the field of artificial intelligence (AI) to build systems that can recognise images, translate languages, drive cars, and control robotic arms. As with real brains, artificial neural networks change their synaptic connections when they learn. This works because computer scientists have developed algorithms for assigning credit in artificial neural networks. However, artificial neural networks still cannot learn as well as human beings. For example, a human can learn to drive a car in a matter of hours, whereas current artificial neural networks take millions of hours. Therefore, though the credit assignment algorithms used in artificial neural networks have been important for AI, they do not tell us exactly how our own brains work. The question we want to answer in this research program is: how does the mammalian brain solve the credit assignment problem, and can we build artificial neural networks that mimic the brain's solution? We will utilise a combination of AI and neuroscience to address this question. This research has significant potential to benefit society. If we could understand how the brain solves the credit assignment problem, then we could simultaneously make two significant leaps forward. First, we would understand how the brain rewires itself when learning. This could help us to develop novel brain-computer interfaces, prosthetic devices, etc. Second, if we understood credit assignment in the brain, we could potentially develop new algorithms for artificial neural networks that would give them the ability to learn more like humans. This could make them faster at learning. Canada is a world-leader in neuroscience inspired AI, and this research will help to train the next generation of researchers, software engineers, and entrepreneurs to help consolidate our position in this field and generate economic benefits for Canadian society.