Grant: Discovery Grants Program - Individual
Carleton University
$18,000.00
Simulation-based Methods for Large Dynamic Latent Variable Models with Unobserved Heterogeneity
FY 2020-21
Summary
In science and engineering, one often needs to study the behaviour of complex dynamic systems through latent variable models. Most of the time, the systems under study are large. For example, a global-scale numerical weather prediction system in geoscience requires estimation of over 10^9 state variables given about 10^7 observations every few hours. Another example is a network-formation model which contains a large number of parameters which may slowly increase with the data complexity as a direct consequence of unobserved heterogeneity a phenomenon where units under study have unobserved individual-specific characteristics that may affect their behaviors. Therefore, current research endeavours should be focused on creating new methods with high scalability to estimate these large-scale latent variable models. In this proposal, I propose a new research agenda in this direction, which builds upon my recent work in time series and panel data econometrics.
Formally, a latent variable model is defined via the joint probability density function (pdf) of an observation process and an unobserved Markov process and this pdf may not possess a tractable mathematical expression. The processes depend on [unknown] parameters that need to be estimated. This estimation task may be feasible using recent techniques developed from the classical or Bayesian perspective if the data has low dimension and the number of parameters does not increase with the amount of data. These techniques are classified into three categories: a) indirect inference; b) data cloning, iterated filtering, and iterated filtering with Bayes maps (used to maximize intractable
likelihood functions); and c) approximate Bayesian computation (ABC) used to compute posterior statistical objects (such as posterior means/modes and probability densities). To circumvent the unscalability problems faced by the existing approaches, I propose simulation-based methods that promise a fast and accurate way to estimate and validate large-scale dynamic latent variable models.
Applications of latent variable models with time series/panel and network data are ubiquitous in many areas, including econometrics, biology, ecology, epidemiology, neuroscience, signal processing, and various fields. In fact, many aforementioned statistical methods to compute maximum likelihood estimates for models without tractable likelihood functions were first proposed to address scientific problems in biology, climatology, and ecology. Therefore, the proposed methods are not limited to econometric/statistical applications. In fact, the methods are derived based on very general dynamical models, allowing the readers to make the most of each technique for their specific applications.
Program
Discovery Grants Program - Individual
Recipient
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
RGPIN-2020-04161
Name nom
Chu, Ba
Department département
Economics
Organization id
23
Institution établissement
Carleton University
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2020
Competition year année de concours
2020
Award amount
18000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1508
Committee name en
Mathematics and Statistics
Committee name fr
Mathématiques et statistique
Area of application code
1212
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Social sciences
Area of application fr
Sciences sociales
Research subject code
3002
Research subject group en
Statistics and probability
Research subject group fr
Statistique et probabilité
Research subject en
Time series analysis
Research subject fr
Analyse des séries chronologiques
Installment
inst:1-5
Partie
5
Nb partie
5
Application title
Simulation-based Methods for Large Dynamic Latent Variable Models with Unobserved Heterogeneity
Keyword
NSERC
Application summary
In science and engineering, one often needs to study the behaviour of complex dynamic systems through latent variable models. Most of the time, the systems under study are large. For example, a global-scale numerical weather prediction system in geoscience requires estimation of over 10^9 state variables given about 10^7 observations every few hours. Another example is a network-formation model which contains a large number of parameters which may slowly increase with the data complexity as a direct consequence of unobserved heterogeneity a phenomenon where units under study have unobserved individual-specific characteristics that may affect their behaviors. Therefore, current research endeavours should be focused on creating new methods with high scalability to estimate these large-scale latent variable models. In this proposal, I propose a new research agenda in this direction, which builds upon my recent work in time series and panel data econometrics.
Formally, a latent variable model is defined via the joint probability density function (pdf) of an observation process and an unobserved Markov process and this pdf may not possess a tractable mathematical expression. The processes depend on [unknown] parameters that need to be estimated. This estimation task may be feasible using recent techniques developed from the classical or Bayesian perspective if the data has low dimension and the number of parameters does not increase with the amount of data. These techniques are classified into three categories: a) indirect inference; b) data cloning, iterated filtering, and iterated filtering with Bayes maps (used to maximize intractable
likelihood functions); and c) approximate Bayesian computation (ABC) used to compute posterior statistical objects (such as posterior means/modes and probability densities). To circumvent the unscalability problems faced by the existing approaches, I propose simulation-based methods that promise a fast and accurate way to estimate and validate large-scale dynamic latent variable models.
Applications of latent variable models with time series/panel and network data are ubiquitous in many areas, including econometrics, biology, ecology, epidemiology, neuroscience, signal processing, and various fields. In fact, many aforementioned statistical methods to compute maximum likelihood estimates for models without tractable likelihood functions were first proposed to address scientific problems in biology, climatology, and ecology. Therefore, the proposed methods are not limited to econometric/statistical applications. In fact, the methods are derived based on very general dynamical models, allowing the readers to make the most of each technique for their specific applications.