Canada Spends Logo

Explorez notre analyse du budget 2026

Grant: Discovery Grants Program - Individual

University of Toronto

$25,000.00

Leveraging structure in privileged information

EF 2023-24

Résumé
This research program will focus on leveraging privileged information to develop new algorithms for learning (parameter estimation and probabilistic inference) and decision making with deep generative models. There are three key objectives to this research program:  Privileged information from large stores of text data: Text data is a rich store of contextual information about many different predictive tasks. Clinical textbooks contain vital information about the manifestation of the disease that can inform predictive models of disease onset. We will develop new learning algorithms for deep generative models that leverage context about predictive tasks presented in text data at training time. We will use neural network based language models to learn which aspects of text data are most helpful to solve a predictive problem at hand. Privileged information in time-series data: Predicting events that occur in the future via survival analysis is a powerful technique used in fields like economics and healthcare, where the goal could be identifying when a patient will develop a complication. But between a patient's baseline data and an event of interest, lie data that characterize the patient's physiological state over time. We will develop new hierarchical latent variable models that uncover structure in time-series privileged information and use this structure to improve the predictive quality and sample complexity of survival analysis models. Privileged information in causal graphs: Latent variable deep generative models use inference networks in the inner loop of learning to predict parameters of the variational distribution. This prediction problem is challenging when data are missing, and little is known about the bias incurred in the variational parameters when inference networks make predictions from missing data. We will study how causal graphs, which characterize the causal relationships among the random variables, can serve as privileged information for inference networks and be used to improve variational inference (and consequently parameter estimation) in deep generative models. This program will apply the algorithms developed in this research program to predictive problems that arise in the natural sciences and engineering including (but not limited to) economics, social sciences and healthcare. The design of sample efficient predictive models can open the door to incorporating emerging data modalities such as proteomics in computational biology. Hierarchical models that can cluster longitudinal, high-dimensional data with time-varying interventions can find patterns of human driving behavior using data from self-driving cars. Finally, the utilization of causal knowledge (in the form of graphs) can lead to novel unsupervised learning algorithms. In summary, this research agenda will open up the utility of machine learning to domains where data is scarce and new problems where labels are expensive to obtain.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data

Tel que publié

Application id
RGPIN-2022-04546
Name nom
Gopalkrishnan, Rahul
Department département
Computer science and medicine
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2023
Competition year année de concours
2022
Award amount
25000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
9999
Research subject group en
Not available
Research subject group fr
Not available
Research subject en
Non disponible
Research subject fr
Non disponible
Application title
Leveraging structure in privileged information
Keyword
causal inference; deep generative models; missing data; neural networks; probabilistic inference; probabilistic modeling; side information; state space models; survival analysis; time series modeling
Application summary
This research program will focus on leveraging privileged information to develop new algorithms for learning (parameter estimation and probabilistic inference) and decision making with deep generative models. There are three key objectives to this research program:  Privileged information from large stores of text data: Text data is a rich store of contextual information about many different predictive tasks. Clinical textbooks contain vital information about the manifestation of the disease that can inform predictive models of disease onset. We will develop new learning algorithms for deep generative models that leverage context about predictive tasks presented in text data at training time. We will use neural network based language models to learn which aspects of text data are most helpful to solve a predictive problem at hand. Privileged information in time-series data: Predicting events that occur in the future via survival analysis is a powerful technique used in fields like economics and healthcare, where the goal could be identifying when a patient will develop a complication. But between a patient's baseline data and an event of interest, lie data that characterize the patient's physiological state over time. We will develop new hierarchical latent variable models that uncover structure in time-series privileged information and use this structure to improve the predictive quality and sample complexity of survival analysis models. Privileged information in causal graphs: Latent variable deep generative models use inference networks in the inner loop of learning to predict parameters of the variational distribution. This prediction problem is challenging when data are missing, and little is known about the bias incurred in the variational parameters when inference networks make predictions from missing data. We will study how causal graphs, which characterize the causal relationships among the random variables, can serve as privileged information for inference networks and be used to improve variational inference (and consequently parameter estimation) in deep generative models. This program will apply the algorithms developed in this research program to predictive problems that arise in the natural sciences and engineering including (but not limited to) economics, social sciences and healthcare. The design of sample efficient predictive models can open the door to incorporating emerging data modalities such as proteomics in computational biology. Hierarchical models that can cluster longitudinal, high-dimensional data with time-varying interventions can find patterns of human driving behavior using data from self-driving cars. Finally, the utilization of causal knowledge (in the form of graphs) can lead to novel unsupervised learning algorithms. In summary, this research agenda will open up the utility of machine learning to domains where data is scarce and new problems where labels are expensive to obtain.