Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Discovery Grants Program - Individual

University of British Columbia

$25,000.00

Robust Estimation and Model Ensemble Selection

FY 2019-20

Summary
Consider a data table with n rows - the cases - and d columns - the variables. The classical robustness model assumes that the majority of the cases are contamination free. Hence, a minority of contaminated cases may need to be identified and filtered. Unfortunately this paradigm is not realistic and collapses in high dimensions. If there is a small and independent probability p that a cell (individual entry in the data table) is contaminated then the probability that a case (a row in the data table) is contaminated is 1-(1-p)^d which can quickly go over 0.5. For example, if p=0.01 and d=100 the probability is 0.63397. The PhD thesis of my former student Fatemah Alqallaf, brings attention to this problem called propagation of outliers. Alqallaf, Van Aelst, Yohai and Zamar (2009) continue this research and shows that traditional high breakdown point estimates are no longer resistant against independent contamination. Hence, the PhD thesis of my former student Andy Leung constructed multivariate location and scatter estimates which are resistant to casewise and cellwise outliers. Extensions of this approach to other multivariate models including cluster analysis will be considered by my new graduate students Glenn McGuinness and Malvika Mitra.***Cheap collection/storage of data produced variable-rich-case-poor data. It is common to find that a large number of the variables in these datasets are noise variables which hurt rather than help inference tasks. Moreover, the remaining useful variables may be partially redundant and subsets of these variables may predict better than the full set. Then it may be better to ensemble several models based on diverse subsets of variables. This lead to a very broad research endeavor - ensemble selection - a generalization of model selection. The PhD thesis of my former student Jabed Tomal proposes an ad-hoc procedure called phalanxes. My PhD student Anthony Christidis will consider a more structured selection of optimal ensembles by optimizing a new loss function that penalizes lack of sparseness and lack of diversity of the models selected for the ensemble. With the help of several grad students I wish to study extensions to linear and nonlinear regression and classification. ***I am also interested in cluster analysis. A popular clustering method is K-means. However, this method is not resistant against outliers. My PhD student Juan D. Gonzalez (University of Buenos Aires, Argentina) is developing a robust alternative by using the Tau-scale (Yohai and Zamar, 1989) instead of the average of the distances from the points to their cluster centers. Application of this procedure to the processing of digitized images is also part of his research project.
Program
Discovery Grants Program - Individual
Location
British Columbia, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
RGPIN-2019-04201
Name nom
Zamar, Ruben
Department département
Statistics
Organization id
2
Institution établissement
University of British Columbia
Province en
British Columbia
Province fr
Colombie-Britannique
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2019
Competition year année de concours
2019
Award amount
25000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1508
Committee name en
Mathematics and Statistics
Committee name fr
Mathématiques et statistique
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
3000
Research subject group en
Statistics and probability
Research subject group fr
Statistique et probabilité
Research subject en
Statistics and probability
Research subject fr
Statistique et probabilité
Installment
inst:1 - 5
Partie
1
Nb partie
5
Application title
Robust Estimation and Model Ensemble Selection
Keyword
NSERC
Application summary
Consider a data table with n rows - the cases - and d columns - the variables. The classical robustness model assumes that the majority of the cases are contamination free. Hence, a minority of contaminated cases may need to be identified and filtered. Unfortunately this paradigm is not realistic and collapses in high dimensions. If there is a small and independent probability p that a cell (individual entry in the data table) is contaminated then the probability that a case (a row in the data table) is contaminated is 1-(1-p)^d which can quickly go over 0.5. For example, if p=0.01 and d=100 the probability is 0.63397. The PhD thesis of my former student Fatemah Alqallaf, brings attention to this problem called propagation of outliers. Alqallaf, Van Aelst, Yohai and Zamar (2009) continue this research and shows that traditional high breakdown point estimates are no longer resistant against independent contamination. Hence, the PhD thesis of my former student Andy Leung constructed multivariate location and scatter estimates which are resistant to casewise and cellwise outliers. Extensions of this approach to other multivariate models including cluster analysis will be considered by my new graduate students Glenn McGuinness and Malvika Mitra.***Cheap collection/storage of data produced variable-rich-case-poor data. It is common to find that a large number of the variables in these datasets are noise variables which hurt rather than help inference tasks. Moreover, the remaining useful variables may be partially redundant and subsets of these variables may predict better than the full set. Then it may be better to ensemble several models based on diverse subsets of variables. This lead to a very broad research endeavor - ensemble selection - a generalization of model selection. The PhD thesis of my former student Jabed Tomal proposes an ad-hoc procedure called phalanxes. My PhD student Anthony Christidis will consider a more structured selection of optimal ensembles by optimizing a new loss function that penalizes lack of sparseness and lack of diversity of the models selected for the ensemble. With the help of several grad students I wish to study extensions to linear and nonlinear regression and classification. ***I am also interested in cluster analysis. A popular clustering method is K-means. However, this method is not resistant against outliers. My PhD student Juan D. Gonzalez (University of Buenos Aires, Argentina) is developing a robust alternative by using the Tau-scale (Yohai and Zamar, 1989) instead of the average of the distances from the points to their cluster centers. Application of this procedure to the processing of digitized images is also part of his research project.