Grant: Discovery Grants Program - Individual
University of Ottawa
$18,000.00
On the Feasibility of Distributed Statistical Learning for Big Data
FY 2020-21
Summary
Collecting data with unprecedented sizes and complexities is now feasible in many scientific fields. Big data have strategic value only when they are effectively utilized to obtain useful information. Developing efficient tools to manage and process big data has been a recent hotspot in statistics and related disciplines.
Due to their huge volume, big data can be rarely stored and processed on a single machine. Therefore, a divide-and-conquer scheme is often used for computational convenience. In such a strategy, a full dataset is split into and processed in several manageable segments; the final output is then aggregated from the segmental sub-outputs. Despite its practical popularity, this distributive framework lacks a solid theoretical foundation. Its performance can vary in different scenarios. Thus, it is necessary to refine the method and provide the associated theoretical support. In this proposal, I plan to systematically investigate the distributive method for a few major statistical learning tasks. Specifically, I have the following three objectives. 1) I will specify the conditions and establish the consistency of simple distributive methods for regression, classification, and ranking purposes. This objective will provide a basic theoretical understanding of the distributive framework, so that better guidance can be provided for its application. 2) Based on distributed optimization, I will design new learning procedures that improve the simple distributive method. The new methods will enhance the communication between individual machines. Thus, they have great potential to make the overall procedure more efficient and reliable. 3) I will apply the developed distributive methods to real-world datasets. This objective will provide a software package for the new methods and address the implementation issues raised in practice. One potential application is improving the prediction system for hospital resources needed by Canadian inpatients. This application will be based on 2015-2020 Discharge Abstract Database available from Canadian Institute for Health Information.
With the above research objectives, this program will build a theoretical foundation and develop efficient implementation procedures for distributive statistical learning. These results and products will be among the key techniques for processing big data. The proposed research objectives will be viewed and investigated jointly from the perspectives of statistics, machine learning, optimization, and approximation theory. All these make this program a novel and promising exploration in the emerging field of big data. The diversified topics in this program are well-suited for training highly qualified personals at both doctoral and master's levels. The scientists trained by this program are urgently needed for analyzing big data in industry, research institutes, and government agencies.
Program
Discovery Grants Program - Individual
Recipient
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
RGPIN-2016-05024
Name nom
Xu, Chen
Department département
Department of Mathematics and Statistics
Organization id
28
Institution établissement
University of Ottawa
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2020
Competition year année de concours
2016
Award amount
18000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1508
Committee name en
Mathematics and Statistics
Committee name fr
Mathématiques et statistique
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
3001
Research subject group en
Statistics and probability
Research subject group fr
Statistique et probabilité
Research subject en
Statistical theory
Research subject fr
Théorie de statistique
Installment
inst:5-6
Partie
2
Nb partie
6
Application title
On the Feasibility of Distributed Statistical Learning for Big Data
Keyword
NSERC
Application summary
Collecting data with unprecedented sizes and complexities is now feasible in many scientific fields. Big data have strategic value only when they are effectively utilized to obtain useful information. Developing efficient tools to manage and process big data has been a recent hotspot in statistics and related disciplines.
Due to their huge volume, big data can be rarely stored and processed on a single machine. Therefore, a divide-and-conquer scheme is often used for computational convenience. In such a strategy, a full dataset is split into and processed in several manageable segments; the final output is then aggregated from the segmental sub-outputs. Despite its practical popularity, this distributive framework lacks a solid theoretical foundation. Its performance can vary in different scenarios. Thus, it is necessary to refine the method and provide the associated theoretical support. In this proposal, I plan to systematically investigate the distributive method for a few major statistical learning tasks. Specifically, I have the following three objectives. 1) I will specify the conditions and establish the consistency of simple distributive methods for regression, classification, and ranking purposes. This objective will provide a basic theoretical understanding of the distributive framework, so that better guidance can be provided for its application. 2) Based on distributed optimization, I will design new learning procedures that improve the simple distributive method. The new methods will enhance the communication between individual machines. Thus, they have great potential to make the overall procedure more efficient and reliable. 3) I will apply the developed distributive methods to real-world datasets. This objective will provide a software package for the new methods and address the implementation issues raised in practice. One potential application is improving the prediction system for hospital resources needed by Canadian inpatients. This application will be based on 2015-2020 Discharge Abstract Database available from Canadian Institute for Health Information.
With the above research objectives, this program will build a theoretical foundation and develop efficient implementation procedures for distributive statistical learning. These results and products will be among the key techniques for processing big data. The proposed research objectives will be viewed and investigated jointly from the perspectives of statistics, machine learning, optimization, and approximation theory. All these make this program a novel and promising exploration in the emerging field of big data. The diversified topics in this program are well-suited for training highly qualified personals at both doctoral and master's levels. The scientists trained by this program are urgently needed for analyzing big data in industry, research institutes, and government agencies.