Grant: Discovery Grants Program - Individual
University of Calgary
$37,000.00
Hidden semi Markov models; stochastic control.
FY 2014-15
Summary
In addition to signal processing, speech processing and other areas, one of the most successful applications of hidden Markov models has been to genome and protein sequencing. My book with L Aggoun and J Moore on ""Hidden Markov Models: Estimation and Control"" was published in 1995 by Springer Verlag and reprinted in 1997. A revised and expanded edition was printed in 2008. I have published several other contributions to hidden Markov models. However, when modelling discrete sequences, for example in discrete time or in biological applications, if the hidden process is a Markov chain its (random) occupation time in any state is a geometrically distributed random variable. For biological applications it appears that more general occupation times should be considered. This leads us to consider semi-Markov models where the probability of jumping to a new state depends not only on the present state but how long the chain has been in that state. We shall consider 'hidden' semi-Markov models, that is situations where the semi-Markov chain is not observed directly but modulates a second, observed, process. We believe these will better model behaviour exhibited in protein and other 'gnome' sequencing. We shall develop for these models the results found in our book and previous works. A second line of research will use our recent results on backward stochastic differential equations to investigate partially observed stochastic control problems. The adjoint process is described by a backward stochastic differential equation; for partially observed problems this is a backward stochastic partial differential equation. Initial work will consider this problem for the control of a partially observed Markov chain
Program
Discovery Grants Program - Individual
Recipient
Location
Alberta, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
RGPIN-2014-04416
Name nom
Elliott, Robert
Department département
Haskayne School of Business
Organization id
11
Institution établissement
University of Calgary
Province en
Alberta
Province fr
Alberta
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2014
Competition year année de concours
2014
Award amount
37000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1510
Committee name en
Electrical and Computer Engineering
Committee name fr
Génie électrique et informatique
Area of application code
1102
Area of application group en
Health, education and social services
Area of application group fr
Santé publique, éducation et services sociaux
Area of application en
Biomedical engineering
Area of application fr
Génie biomédical
Research subject code
2509
Research subject group en
Electrical and electronic engineering
Research subject group fr
Génie électrique et électronique
Research subject en
Control systems
Research subject fr
Asservissements
Partie
1
Nb partie
1
Application title
Hidden semi Markov models; stochastic control.
Keyword
NSERC
Application summary
In addition to signal processing, speech processing and other areas, one of the most successful applications of hidden Markov models has been to genome and protein sequencing. My book with L Aggoun and J Moore on ""Hidden Markov Models: Estimation and Control"" was published in 1995 by Springer Verlag and reprinted in 1997. A revised and expanded edition was printed in 2008. I have published several other contributions to hidden Markov models. However, when modelling discrete sequences, for example in discrete time or in biological applications, if the hidden process is a Markov chain its (random) occupation time in any state is a geometrically distributed random variable. For biological applications it appears that more general occupation times should be considered. This leads us to consider semi-Markov models where the probability of jumping to a new state depends not only on the present state but how long the chain has been in that state. We shall consider 'hidden' semi-Markov models, that is situations where the semi-Markov chain is not observed directly but modulates a second, observed, process. We believe these will better model behaviour exhibited in protein and other 'gnome' sequencing. We shall develop for these models the results found in our book and previous works. A second line of research will use our recent results on backward stochastic differential equations to investigate partially observed stochastic control problems. The adjoint process is described by a backward stochastic differential equation; for partially observed problems this is a backward stochastic partial differential equation. Initial work will consider this problem for the control of a partially observed Markov chain