Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Discovery Grants Program - Individual

University of Calgary

$30,000.00

Estimation and filtering of hidden semi Markov models, event based filters and stochastic control.

FY 2016-17

Summary
The central objective of the work will be the derivation of new algorithms for signal processing, in particular the estimation of information hidden in noisy signals. This will build on previous contributions by the applicant. Three directions will be pursued. The first will develop new estimation algorithms for hidden semi Markov models, extending our previous work on hidden Markov models. The second will consider event based filtering problems when the observed process is received only when the hidden signal changes by more than a specified amount or when the signal process crosses certain levels. The third will discuss the optimal control of a noisily observed Markov chain using backward stochastic differential equations. In addition to signal processing, speech processing and other areas, an important application of hidden Markov models has been to genome and protein sequencing. However, when modelling discrete sequences, for example in discrete time or in biological applications, if the hidden process is a Markov chain its (random) occupation time in any state is a geometrically distributed random variable. In many areas of applications, including queuing theory, reliability and maintenance, survival analysis, performance evaluation, biology, DNA analysis, and genome sequencing, it seems more general occupation times should be considered. This leads us to consider semi-Markov models. We shall consider 'hidden' semi-Markov models, that is situations where the semi-Markov chain is not observed directly but modulates a second, observed, process.  We shall develop for these models the results found in our book and previous publications.  In the digital world, continuous-time signals must be sampled. Traditionally, they are sampled uniformly in time. The term 'event-based sampling' can refer to the traditional uniform time step sampling, (sometimes called Riemann sampling), but it usually means that samples are taken in response to a priori defined events, such as when the signal changes by more than a specified amount, (send-on-delta), or when it crosses specified levels, (Lebesgue sampling). The objectives of the work will be to obtain new implementable filters. The theory of event-based sampling is more involved but there are many practical benefits including cheaper sensors, reduced communication costs and less data to process.  The third line of research will use our recent results on backward stochastic differential equations to investigate partially observed stochastic control problems. The adjoint process is described by a backward stochastic differential equation; for partially observed problems this is a backward stochastic partial differential equation. Initially we consider this problem for the control of a partially observed Markov chain where a system of backward stochastic ordinary differential equations will give criteria which determine an optimal control.
Program
Discovery Grants Program - Individual
Location
Alberta, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
RGPIN-2015-06084
Name nom
Elliott, Robert
Department département
Haskayne School of Business - Haskayne School of Business
Organization id
11
Institution établissement
University of Calgary
Province en
Alberta
Province fr
Alberta
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2016
Competition year année de concours
2015
Award amount
30000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1510
Committee name en
Electrical and Computer Engineering
Committee name fr
Génie électrique et informatique
Area of application code
805
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Communications technologies (satellites, radar, etc.)
Area of application fr
Technologie des télécommunications (satellites, radar,etc.)
Research subject code
2509
Research subject group en
Electrical and electronic engineering
Research subject group fr
Génie électrique et électronique
Research subject en
Control systems
Research subject fr
Asservissements
Partie
2
Nb partie
5
Application title
Estimation and filtering of hidden semi Markov models, event based filters and stochastic control.
Keyword
NSERC
Application summary
The central objective of the work will be the derivation of new algorithms for signal processing, in particular the estimation of information hidden in noisy signals. This will build on previous contributions by the applicant. Three directions will be pursued. The first will develop new estimation algorithms for hidden semi Markov models, extending our previous work on hidden Markov models. The second will consider event based filtering problems when the observed process is received only when the hidden signal changes by more than a specified amount or when the signal process crosses certain levels. The third will discuss the optimal control of a noisily observed Markov chain using backward stochastic differential equations. In addition to signal processing, speech processing and other areas, an important application of hidden Markov models has been to genome and protein sequencing. However, when modelling discrete sequences, for example in discrete time or in biological applications, if the hidden process is a Markov chain its (random) occupation time in any state is a geometrically distributed random variable. In many areas of applications, including queuing theory, reliability and maintenance, survival analysis, performance evaluation, biology, DNA analysis, and genome sequencing, it seems more general occupation times should be considered. This leads us to consider semi-Markov models. We shall consider 'hidden' semi-Markov models, that is situations where the semi-Markov chain is not observed directly but modulates a second, observed, process.  We shall develop for these models the results found in our book and previous publications.  In the digital world, continuous-time signals must be sampled. Traditionally, they are sampled uniformly in time. The term 'event-based sampling' can refer to the traditional uniform time step sampling, (sometimes called Riemann sampling), but it usually means that samples are taken in response to a priori defined events, such as when the signal changes by more than a specified amount, (send-on-delta), or when it crosses specified levels, (Lebesgue sampling). The objectives of the work will be to obtain new implementable filters. The theory of event-based sampling is more involved but there are many practical benefits including cheaper sensors, reduced communication costs and less data to process.  The third line of research will use our recent results on backward stochastic differential equations to investigate partially observed stochastic control problems. The adjoint process is described by a backward stochastic differential equation; for partially observed problems this is a backward stochastic partial differential equation. Initially we consider this problem for the control of a partially observed Markov chain where a system of backward stochastic ordinary differential equations will give criteria which determine an optimal control.