Grant: Discovery Grants Program - Individual
University of Toronto
$56,000.00
Efficient Inference in Compositional Generative Models
EF 2022-23
Résumé
The objective of this program is to allow the automatic construction of complex, interpretable models directly from data, automating analysis previously done by experts.I will achieve this by further developing tools for automatically building structured deep generative models.Such models assert that the data has a hidden underlying structure, observed indirectly through complex, noisy processes.This will require novel inference, training and evaluation procedures, but will enable advances in a wide variety of machine learning applications, including automated chemical design, and model-based deep reinforcement learning.Specifically, we propose to develop a new model class having arbitrarily complex latent variable structure, and deep nonlinear observation models. This research will extend recent lines of inquiry that combine the best aspects of probabilistic graphical models (PGMs) and neural networks. These new models combine the interpretability and tractability of structured graphical models (such as clustering, time-series, or topic models) with the flexibility of neural network-based likelihood functions. This combination can sidestep the rigid modeling assumptions made by PGMs such as Gaussianity. It also sidesteps limitations of neural networks, namely their relative uninterpretability, as well as the requirement of having very large datasets.Such model classes have been previously proposed, but their usefulness was limited by slow inference methods. We outline a concrete plan for exploiting the structure of the models themselves to develop efficient inference techniques. These methods extend recently-developed variational autoencoders (VAEs) to produce structured variational autoencoders (SVAEs).These inference methods have the potential to make automatic model-building frameworks practical. In particular, we plan to extend existing matrix decomposition grammars in two ways. First, to handle non-linear observation models connecting different types of latent structures to each other and to the data. Second, to be scalable enough to handle real-world datasets. This modeling framework already contains many standard machine learning and machine vision models as special cases. Providing it with flexible neural-net observation models would mean that it would also contain most deep learning models as special cases, as well as a host of as-yet-undeveloped new model classes. Using fast recognition networks to do inference would mean that inference in this large model class would be scalable.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2017-06676
Name nom
Duvenaud, David
Department département
Computer Science (St. George Campus) - Computer Science (St. George Campus)
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2022
Competition year année de concours
2017
Award amount
56000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
1200
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Advancement of knowledge
Area of application fr
Avancement des connaissances
Research subject code
2800
Research subject group en
Artificial intelligence
Research subject group fr
Intelligence artificielle
Research subject en
Artificial intelligence (computer vision, use2603)
Research subject fr
Intelligence artificielle (vision artificielle, utiliser 2603)
Installment
inst:6;7
Partie
2
Nb partie
7
Application title
Efficient Inference in Compositional Generative Models
Application summary
The objective of this program is to allow the automatic construction of complex, interpretable models directly from data, automating analysis previously done by experts.I will achieve this by further developing tools for automatically building structured deep generative models.Such models assert that the data has a hidden underlying structure, observed indirectly through complex, noisy processes.This will require novel inference, training and evaluation procedures, but will enable advances in a wide variety of machine learning applications, including automated chemical design, and model-based deep reinforcement learning.Specifically, we propose to develop a new model class having arbitrarily complex latent variable structure, and deep nonlinear observation models. This research will extend recent lines of inquiry that combine the best aspects of probabilistic graphical models (PGMs) and neural networks. These new models combine the interpretability and tractability of structured graphical models (such as clustering, time-series, or topic models) with the flexibility of neural network-based likelihood functions. This combination can sidestep the rigid modeling assumptions made by PGMs such as Gaussianity. It also sidesteps limitations of neural networks, namely their relative uninterpretability, as well as the requirement of having very large datasets.Such model classes have been previously proposed, but their usefulness was limited by slow inference methods. We outline a concrete plan for exploiting the structure of the models themselves to develop efficient inference techniques. These methods extend recently-developed variational autoencoders (VAEs) to produce structured variational autoencoders (SVAEs).These inference methods have the potential to make automatic model-building frameworks practical. In particular, we plan to extend existing matrix decomposition grammars in two ways. First, to handle non-linear observation models connecting different types of latent structures to each other and to the data. Second, to be scalable enough to handle real-world datasets. This modeling framework already contains many standard machine learning and machine vision models as special cases. Providing it with flexible neural-net observation models would mean that it would also contain most deep learning models as special cases, as well as a host of as-yet-undeveloped new model classes. Using fast recognition networks to do inference would mean that inference in this large model class would be scalable.