Grant: Discovery Grants Program - Individual
University of Toronto
$66,000.00
Visual imagery: an investigation of its neural and computational basis
FY 2024-25
Summary
How do we experience the visual appearance of an object when we conjure up its image in the mind's eye? Visual imagery is key to many human activities, such as learning, reminiscing and planning. Accordingly, this cognitive ability has elicited long-standing interest and debate in neuroscience and psychology. Yet, the precise mechanisms by which imagery is carried out at the neural level remain to be elucidated. The overarching goal of the current proposal is to develop a neurocomputational account of visual imagery.
Specifically, the current proposal aims to answer a number of fundamental challenges in the field. First, it seeks to clarify where and how visual imagery unfolds over time in the human brain. Second, it aims to describe the detailed content of imagery experiences and visualize it based on neural data. And third, it seeks to develop a computational model able to account for visual imagery and its relationship with visual perception. Of note, this work aims to develop novel methodology for neural-based image reconstruction in order to recover the content of imagery representations (e.g., visualizing the appearance of a friend's face as recovered from memory or that of an imagined letter string).
The aims above will be pursued primarily within the areas of face and visual word recognition, given their relevance and utility to the study of imagery and perception. This work will rely on a combination of psychophysical testing, computational modeling (i.e., deep neural networks) and neuroimaging, specifically functional magnetic resonance imaging (fMRI) and electroencephalography (EEG), in healthy adults.
The work outlined above has the potential to place the study of visual imagery on a novel computational footing. Theoretically, this work can deepen our understanding of neural mechanisms for visual cognition. Methodologically, it furthers the development of analytical tools for neural data decoding and for neural-based image reconstruction. Practically, it lays the groundwork for a novel mode of interpersonal communication relying on neural read-outs of visual imagery (e.g., sharing an individual's mental impression by the conversion of corresponding neural data into a visual display).
Program
Discovery Grants Program - Individual
Recipient
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
RGPIN-2020-06014
Name nom
Nestor, Adrian
Department département
Psychology (Scarborough) - Psychology (Scarborough)
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2024
Competition year année de concours
2020
Award amount
66000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1502
Committee name en
Biological Systems and Functions
Committee name fr
Systèmes et fonctions biologiques
Area of application code
1210
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Psychology
Area of application fr
Psychologie
Research subject code
6302
Research subject group en
Psychology
Research subject group fr
Psychologie
Research subject en
Sensory systems -- visual
Research subject fr
Systèmes sensoriels -- vue
Field of research list names en
Not available
Field of research list names fr
Non disponible
Socioeconomic objective list names en
Not available
Socioeconomic objective list names fr
Non disponible
Application title
Visual imagery: an investigation of its neural and computational basis
Keywords
visual cognition; eeg; fmri; multivariate pattern analysis; convolutional neural networks; computational modeling; face recognition; visual word recognition; neural dynamics
Application summary
How do we experience the visual appearance of an object when we conjure up its image in the mind's eye? Visual imagery is key to many human activities, such as learning, reminiscing and planning. Accordingly, this cognitive ability has elicited long-standing interest and debate in neuroscience and psychology. Yet, the precise mechanisms by which imagery is carried out at the neural level remain to be elucidated. The overarching goal of the current proposal is to develop a neurocomputational account of visual imagery.
Specifically, the current proposal aims to answer a number of fundamental challenges in the field. First, it seeks to clarify where and how visual imagery unfolds over time in the human brain. Second, it aims to describe the detailed content of imagery experiences and visualize it based on neural data. And third, it seeks to develop a computational model able to account for visual imagery and its relationship with visual perception. Of note, this work aims to develop novel methodology for neural-based image reconstruction in order to recover the content of imagery representations (e.g., visualizing the appearance of a friend's face as recovered from memory or that of an imagined letter string).
The aims above will be pursued primarily within the areas of face and visual word recognition, given their relevance and utility to the study of imagery and perception. This work will rely on a combination of psychophysical testing, computational modeling (i.e., deep neural networks) and neuroimaging, specifically functional magnetic resonance imaging (fMRI) and electroencephalography (EEG), in healthy adults.
The work outlined above has the potential to place the study of visual imagery on a novel computational footing. Theoretically, this work can deepen our understanding of neural mechanisms for visual cognition. Methodologically, it furthers the development of analytical tools for neural data decoding and for neural-based image reconstruction. Practically, it lays the groundwork for a novel mode of interpersonal communication relying on neural read-outs of visual imagery (e.g., sharing an individual's mental impression by the conversion of corresponding neural data into a visual display).