Grant: Discovery Grants Program - Individual
University of Manitoba
$37,000.00
Semiparametric learning in signal processing, communication systems and pattern recognition
FY 2009-10
Summary
Learning is the process of moving from concrete examples (training data) to models that can explain and predict the underlying process. Formally learning is the problem of recovering (from the training data) a mapping from input signals to output ones. The accuracy of the mapping to be learned from the data depends on the a priori knowledge of the process. Fully nonparametric learning methods do not need any a priori information and therefore are robust and do not suffer from risk of misspecification. On the other hand they exhibit slow learning rate, which deteriorates considerably with the dimensionality of the underlying objects, e.g., images. In contrast, classical parametric learning algorithms carries a great risk of misspecification, but if they are correctly specified they will enjoy fast learning rates with no deterioration caused by multivariate data. These two basic learning schemes have found numerous applications in such diverse areas as: medical diagnostics, data mining, qualitative economics, communication engineering, speech and pattern recognition. In practice, the dimensionality and sparseness of data force us to accept an intermediate model (semiparametric model) which lies between parametric and fully nonparametric cases. The parametric part of the model defines parameters of finite-dimensional projections of multivariate nonlinearities, whereas nonlinear characteristics run through a nonparametric class of univariate functions. This semiparametric model allows one to design practical learning algorithms which share the efficiency of parametric modeling while preserving the high flexibility of the nonparametric case, i.e., we wish to take the best of both worlds. In fact, in semiparametric models the curse of dimensionality can be entirely eliminated. The purpose of this research is twofold. First we propose to examine theoretical advancements, numerical implementations, and testing the accuracy of specific learning schemes within the aforementioned semiparametric framework. Second, we intend to apply this methodology to concrete cases beyond the traditional AI field such as: signal processing, communication systems, pattern recognition , and image analysis.
Program
Discovery Grants Program - Individual
Recipient
Location
Manitoba, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
8131-2007
Name nom
Pawlak, Miroslaw
Department département
Electrical and Computer Engineering
Organization id
19
Institution établissement
University of Manitoba
Province en
Manitoba
Province fr
Manitoba
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2009
Competition year année de concours
2007
Award amount
37000
Program id
RGPIN
Program nane en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
331
Committee name en
Computing and Information Sciences - B
Committee name fr
Informatique - B
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
2805
Research subject group en
Artificial intelligence
Research subject group fr
Intelligence artificielle
Research subject en
Learning and inference theories
Research subject fr
Théories de l'apprentissage et l'inférence
Partie
3
Nb partie
5
Application title
Semiparametric learning in signal processing, communication systems and pattern recognition
Keyword
NA
Application summary
Learning is the process of moving from concrete examples (training data) to models that can explain and predict the underlying process. Formally learning is the problem of recovering (from the training data) a mapping from input signals to output ones. The accuracy of the mapping to be learned from the data depends on the a priori knowledge of the process. Fully nonparametric learning methods do not need any a priori information and therefore are robust and do not suffer from risk of misspecification. On the other hand they exhibit slow learning rate, which deteriorates considerably with the dimensionality of the underlying objects, e.g., images. In contrast, classical parametric learning algorithms carries a great risk of misspecification, but if they are correctly specified they will enjoy fast learning rates with no deterioration caused by multivariate data. These two basic learning schemes have found numerous applications in such diverse areas as: medical diagnostics, data mining, qualitative economics, communication engineering, speech and pattern recognition. In practice, the dimensionality and sparseness of data force us to accept an intermediate model (semiparametric model) which lies between parametric and fully nonparametric cases. The parametric part of the model defines parameters of finite-dimensional projections of multivariate nonlinearities, whereas nonlinear characteristics run through a nonparametric class of univariate functions. This semiparametric model allows one to design practical learning algorithms which share the efficiency of parametric modeling while preserving the high flexibility of the nonparametric case, i.e., we wish to take the best of both worlds. In fact, in semiparametric models the curse of dimensionality can be entirely eliminated. The purpose of this research is twofold. First we propose to examine theoretical advancements, numerical implementations, and testing the accuracy of specific learning schemes within the aforementioned semiparametric framework. Second, we intend to apply this methodology to concrete cases beyond the traditional AI field such as: signal processing, communication systems, pattern recognition , and image analysis.