Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Discovery Grants Program - Individual

Dalhousie University

$42,000.00

Efficient Data Structures for In-Memory Processing of Large Data Sets

FY 2024-25

Summary
The problem of efficiently storing and retrieving information is an essential topic in computer science. During the past decades, many techniques have been developed to index data so that useful information can be retrieved almost instantaneously by performing queries for keywords or phrases. In recent years, as the size of the data has grown rapidly, many techniques that were useful for small, older systems have become infeasible for large, modern applications, because they occupy too much space to fit into faster levels of memory hierarchy. Most of this space is not raw data, but structural information added to improve search efficiency. Succinct data structures were proposed to address this problem, so that the information in large systems can be retrieved quickly, but the space requirement is little more than that of the raw data. To provide solutions to modern systems that process large data sets such as web search engines, geographic information systems, social network platforms and bioinformatics applications, this program will extend the research on succinct data structures and start new research directions on the design of efficient data structures in general. One research direction is to add more complex search functionalities to succinct data structures for many classes of graphs, in addition to the support of basic navigational operations. One complex query to consider is the computation of distance between two nodes in a graph, which is often used to determine how closely the two entities they represent are related to each other in data analytics applications. Another research direction is on the design of efficient data structures for dynamic graphs, as graphs in many real-world applications are updated constantly. Specifically, we plan to extend a new approach we are currently developing for dynamic interval graphs to design dynamic data structures for computational problems over geometric intersection graphs which model the intersection between geometric objects and have natural applications in wireless communication. For this work, we also intend to apply an additional strategy which is to use succinct data structures as building blocks to store more information in data structure solutions to speed up queries without using more space asymptotically. Finally, during our recent research, we encountered several data structure problems that have fine-grained complexity results, which, based on reductions from well-known problems such as Boolean matrix multiplication, give evidence on the difficulty on further improving existing combinatorial solutions. To improve the throughput of the information systems that need solutions to these query problems, we intend to use methods based on algebraic approaches of matrix multiplication to design solutions that can process a batch of these queries more quickly.
Program
Discovery Grants Program - Individual
Location
Nova Scotia, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
RGPIN-2024-05953
Name nom
He, Meng
Department département
Faculty of Computer Science
Organization id
79
Institution établissement
Dalhousie University
Province en
Nova Scotia
Province fr
Nouvelle-Écosse
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2024
Competition year année de concours
2024
Award amount
42000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
801
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Computer software
Area of application fr
Logiciel
Research subject code
2713
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Algorithms
Research subject fr
Algorithmes
Field of research list names en
Not available
Field of research list names fr
Non disponible
Socioeconomic objective list names en
Not available
Socioeconomic objective list names fr
Non disponible
Application title
Efficient Data Structures for In-Memory Processing of Large Data Sets
Keywords
data structures; succinct data structures; space-efficient data structures; dynamic data structures; geometric data structures; graph data structures; text indexing; algorithms
Application summary
The problem of efficiently storing and retrieving information is an essential topic in computer science. During the past decades, many techniques have been developed to index data so that useful information can be retrieved almost instantaneously by performing queries for keywords or phrases. In recent years, as the size of the data has grown rapidly, many techniques that were useful for small, older systems have become infeasible for large, modern applications, because they occupy too much space to fit into faster levels of memory hierarchy. Most of this space is not raw data, but structural information added to improve search efficiency. Succinct data structures were proposed to address this problem, so that the information in large systems can be retrieved quickly, but the space requirement is little more than that of the raw data. To provide solutions to modern systems that process large data sets such as web search engines, geographic information systems, social network platforms and bioinformatics applications, this program will extend the research on succinct data structures and start new research directions on the design of efficient data structures in general. One research direction is to add more complex search functionalities to succinct data structures for many classes of graphs, in addition to the support of basic navigational operations. One complex query to consider is the computation of distance between two nodes in a graph, which is often used to determine how closely the two entities they represent are related to each other in data analytics applications. Another research direction is on the design of efficient data structures for dynamic graphs, as graphs in many real-world applications are updated constantly. Specifically, we plan to extend a new approach we are currently developing for dynamic interval graphs to design dynamic data structures for computational problems over geometric intersection graphs which model the intersection between geometric objects and have natural applications in wireless communication. For this work, we also intend to apply an additional strategy which is to use succinct data structures as building blocks to store more information in data structure solutions to speed up queries without using more space asymptotically. Finally, during our recent research, we encountered several data structure problems that have fine-grained complexity results, which, based on reductions from well-known problems such as Boolean matrix multiplication, give evidence on the difficulty on further improving existing combinatorial solutions. To improve the throughput of the information systems that need solutions to these query problems, we intend to use methods based on algebraic approaches of matrix multiplication to design solutions that can process a batch of these queries more quickly.
Dalhousie University - $42,000 Grant (2024-25) | Canada Spends