Grant: Discovery Grants Program - Individual
The University of British Columbia
$18,000.00
Nonparametric statistical methods based on graph theory
FY 2023-24
Summary
High-dimensional data, or data spanning multiple dimensions such as time and space, pose unique challenges for data processing in an era of ever-increasing amounts of data availability. Graph theory can provide a structure of high-dimensional data. Currently, two kinds of graph structures have been studied in nonparametric statistics: minimum spanning tree and shortest Hamiltonian path, where the sum of edge distances attains the minimum among all of the trees or paths. My long-term objective is to explore a new class of nonparametric statistical methods based on graph theory. Over the next five years, I intend to bring graph theory into a fully developed and growing field of nonparametric statistics. With my team of HQP and collaborators, I will explore graph theory for change point detection (the change point refers to a location or time at which observations or data obey two different models: before and after), multiple-sample test, and clustering. My specific short-term objectives are focused on three threads. The first research thread will focus on three types of advances in change point detection: 1) proposing a weighted cusum statistic for univariate data, 2) using approximate shortest Hamiltonian path for high-dimensional data, and 3) developing resonance technology for multiple change points. These new methods will be applied to a library of images that can be considered as high-dimensional data. For example, medical images for functional detection of blood oxygen levels, webcams for motion detection, and Earthorbiting satellites for smoke/fire detection. Second, we will compare multiple independent samples using approximate shortest Hamiltonian path. Here, we will study how to efficiently adjust the experimental alignment or choose partial appropriate results for dependent-sample comparison. These techniques are well suited to address challenges in gene data, where the dimensionality of each observation is in the thousands, but there are only tens or hundreds of instances available for study. For the third area, we introduce a hierarchical clustering without predetermining the number of clusters, where the top cluster is the approximate shortest Hamiltonian path. We will propose an optimal clustering and show it is asymptotically identical to the correct clustering. These techniques will be applied for understanding how the COVID-19 outbreak spreads worldwide. A diverse group of HQP, including at least 1 PDF, 2 PhD, 1 MSc, and 4 UG will be trained as part of this proposal. Findings will have direct application for government agencies charged with disease control, wildfire detection, and medical abnormality detection. The team's research and training activities will thus help Canada make efficient and evidence-based decision in the face of unforeseen situations. For theoretical contributions, this proposal explains why and how graph theory works for high-dimensional data with applications to the three threads.
Program
Discovery Grants Program - Individual
Recipient
Location
British Columbia, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
RGPIN-2022-03264
Name nom
Shi, Xiaoping
Department département
Mathematics - Mathematics
Organization id
2
Institution établissement
The University of British Columbia
Province en
British Columbia
Province fr
Colombie-Britannique
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2023
Competition year année de concours
2022
Award amount
18000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1508
Committee name en
Mathematics and Statistics
Committee name fr
Mathématiques et statistique
Area of application code
401
Area of application group en
Environment
Area of application group fr
Environnement
Area of application en
Climate and atmosphere
Area of application fr
Climat et atmosphère
Research subject code
3010
Research subject group en
Statistics and probability
Research subject group fr
Nonparametric inference
Research subject en
Statistique et probabilité
Research subject fr
Inférence non paramétrique
Application title
Nonparametric statistical methods based on graph theory
Keyword
Asymptotic distributions; Change-point detection; Expansions of distributions; Graph-based method; Hierarchical clustering; High-dimensional data; Multiple-sample comparison; Optimal cutting; Penalized purity; Weighted cusum statistics
Application summary
High-dimensional data, or data spanning multiple dimensions such as time and space, pose unique challenges for data processing in an era of ever-increasing amounts of data availability. Graph theory can provide a structure of high-dimensional data. Currently, two kinds of graph structures have been studied in nonparametric statistics: minimum spanning tree and shortest Hamiltonian path, where the sum of edge distances attains the minimum among all of the trees or paths. My long-term objective is to explore a new class of nonparametric statistical methods based on graph theory. Over the next five years, I intend to bring graph theory into a fully developed and growing field of nonparametric statistics. With my team of HQP and collaborators, I will explore graph theory for change point detection (the change point refers to a location or time at which observations or data obey two different models: before and after), multiple-sample test, and clustering. My specific short-term objectives are focused on three threads. The first research thread will focus on three types of advances in change point detection: 1) proposing a weighted cusum statistic for univariate data, 2) using approximate shortest Hamiltonian path for high-dimensional data, and 3) developing resonance technology for multiple change points. These new methods will be applied to a library of images that can be considered as high-dimensional data. For example, medical images for functional detection of blood oxygen levels, webcams for motion detection, and Earthorbiting satellites for smoke/fire detection. Second, we will compare multiple independent samples using approximate shortest Hamiltonian path. Here, we will study how to efficiently adjust the experimental alignment or choose partial appropriate results for dependent-sample comparison. These techniques are well suited to address challenges in gene data, where the dimensionality of each observation is in the thousands, but there are only tens or hundreds of instances available for study. For the third area, we introduce a hierarchical clustering without predetermining the number of clusters, where the top cluster is the approximate shortest Hamiltonian path. We will propose an optimal clustering and show it is asymptotically identical to the correct clustering. These techniques will be applied for understanding how the COVID-19 outbreak spreads worldwide. A diverse group of HQP, including at least 1 PDF, 2 PhD, 1 MSc, and 4 UG will be trained as part of this proposal. Findings will have direct application for government agencies charged with disease control, wildfire detection, and medical abnormality detection. The team's research and training activities will thus help Canada make efficient and evidence-based decision in the face of unforeseen situations. For theoretical contributions, this proposal explains why and how graph theory works for high-dimensional data with applications to the three threads.