Grant: Discovery Grants Program - Individual
University of Toronto
$36,000.00
Accelerating Data Analytics Through Emerging Software-Hardware Mechanisms
EF 2019-20
Résumé
The objectives of this research are to investigate algorithms, design, and architectures for enabling an efficient real-time event data analytics platform to support multi-query processing over high-volume and high-frequency event streams. To achieve these objectives, we plan to leverage modern hardware mechanisms, such as Field Programmable Gate Arrays (FPGAs) and Application Processing Units (APUs) in our design. We strive to achieve line-rate multi-query processing by exploiting unprecedented degrees of parallelism and potential for pipelining, only available through custom-built, application-specific and low-level logic design. Furthermore, we intend to compare against the use of emerging Graphical Processing Units (GPUs) in our design, evaluating above all performance, but also development effort.******The need for efficient real-time analytics is an integral part of a growing number of data management problem scenarios such as business analytics, big data processing, and complex event processing. Common among all these scenarios is a predefined set of continuous queries and an unbounded event stream of incoming data that must be processed against the queries in real-time.******However, the vision of enhancing data analytics computations with FPGAs has a few caveats that make acceleration a challenging undertaking. First, current FPGAs are still much slower compared to commodity CPUs. Second, the accelerated application functionality has to be amenable to parallel processing. Third, the on-/off-chip data rates must keep up with chip processing speeds to realize a processing speedup by keeping the custom-built processing pipeline busy. Finally, FPGAs restrict the designer's flexibility and the application's dynamism, both of which are hardly a concern in standard software solutions.******By meeting these challenges in our approach, we propose an FPGA-based real-time analytics platform that supports line-rate processing of data streams over a collection of continuous queries. We plan to explore this problem space along the following three dimensions: (1) Design high-throughput, custom circuits to implement the relational algebra operators, (2) design multi-query optimization techniques amenable to the features offered by FPGAs, (3) design software-to-hardware multi-query processing techniques that map a set of queries into a global query plan for processing by our custom circuits.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2015-04358
Name nom
Jacobsen, HansArno
Department département
Electrical & Computer Engineering
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2019
Competition year année de concours
2015
Award amount
36000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
801
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Computer software
Area of application fr
Logiciel
Research subject code
2705
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Software and development
Research subject fr
Logiciels et développement
Installment
inst:5 - 5
Partie
5
Nb partie
5
Application title
Accelerating Data Analytics Through Emerging Software-Hardware Mechanisms
Keyword
NSERC
Application summary
The objectives of this research are to investigate algorithms, design, and architectures for enabling an efficient real-time event data analytics platform to support multi-query processing over high-volume and high-frequency event streams. To achieve these objectives, we plan to leverage modern hardware mechanisms, such as Field Programmable Gate Arrays (FPGAs) and Application Processing Units (APUs) in our design. We strive to achieve line-rate multi-query processing by exploiting unprecedented degrees of parallelism and potential for pipelining, only available through custom-built, application-specific and low-level logic design. Furthermore, we intend to compare against the use of emerging Graphical Processing Units (GPUs) in our design, evaluating above all performance, but also development effort.******The need for efficient real-time analytics is an integral part of a growing number of data management problem scenarios such as business analytics, big data processing, and complex event processing. Common among all these scenarios is a predefined set of continuous queries and an unbounded event stream of incoming data that must be processed against the queries in real-time.******However, the vision of enhancing data analytics computations with FPGAs has a few caveats that make acceleration a challenging undertaking. First, current FPGAs are still much slower compared to commodity CPUs. Second, the accelerated application functionality has to be amenable to parallel processing. Third, the on-/off-chip data rates must keep up with chip processing speeds to realize a processing speedup by keeping the custom-built processing pipeline busy. Finally, FPGAs restrict the designer's flexibility and the application's dynamism, both of which are hardly a concern in standard software solutions.******By meeting these challenges in our approach, we propose an FPGA-based real-time analytics platform that supports line-rate processing of data streams over a collection of continuous queries. We plan to explore this problem space along the following three dimensions: (1) Design high-throughput, custom circuits to implement the relational algebra operators, (2) design multi-query optimization techniques amenable to the features offered by FPGAs, (3) design software-to-hardware multi-query processing techniques that map a set of queries into a global query plan for processing by our custom circuits.