Grant: Discovery Grants Program - Individual
University of Manitoba
$41,000.00
Big data mining of useful patterns
FY 2023-24
Summary
In the current era of big data, high volumes of a wide variety of valuable data of different veracity (e.g., imprecise or uncertain data like sensor data and medical lab test results, in which the contents are uncertain due to factors like inherited measurement inaccuracies or sampling frequency) are generated or collected at a high velocity. Consequently, we are drowning in data but starving for knowledge. In order to be able to make sense of these data, data science solutions for big data mining (which discovers implicit, previously unknown & potentially useful knowledge that might be embedded in data) are in demand. Traditional algorithms mine Boolean frequent sets of items capturing only presence or absence of items in the pattern. To reflect the reality in numerous real-life applications, I propose in this research program for big pattern mining of useful patterns. In particular, I aim to discover high-utility subgraphs. These are patterns with high utility values capturing features like quantity & profit of the items in addition to the presence of the items. The subgraph captures spatial relationships among related items. To the best of my knowledge, there have not yet been works on mining high-utility subgraphs. Besides discovering from static precise data, I also plan to mine high-utility subgraphs from dynamic streams and uncertain data. This reflects the reality that we are living in an uncertain but dynamic world, where attributes of items & spatial relationships among related items can change over time. Moreover, I also plan to first visualize the distribution of these subgraphs based on their numbers of vertices and edges. I then provide users with privileges to zoom in to collections of subgraphs of their interest. This gives better interpretation of the mined high-utility subgraphs. Practicality of this visualization will be evaluated through case studies conducted on an inclusive diverse group of participants. The resulting mining system allows users to specify their interest and preference. It pushes their preference in the mining process and focus on it. This, in turn, helps users to enrich their knowledge so that they could promptly take appropriate actions or to make the best decision. It also demonstrates that this research program for big pattern mining of useful patterns-through the mining of high-utility subgraphs from real-life precise & uncertain static data, as well as dynamic streams of precise data-would have significant positive impacts on the improvement of human life and the benefits to Canadian economy.
Program
Discovery Grants Program - Individual
Recipient
Location
Manitoba, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
RGPIN-2023-05688
Name nom
Leung, Carson Kai-Sang
Department département
Computer Science
Organization id
19
Institution établissement
University of Manitoba
Province en
Manitoba
Province fr
Manitoba
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2023
Competition year année de concours
2023
Award amount
41000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2711
Research subject group en
Information technology
Research subject group fr
Database management
Research subject en
Technologie de l'information
Research subject fr
Gestion de bases de données
Application title
Big data mining of useful patterns
Keyword
Big data analytics; Big data applications; Databases; Data management; Data mining; Data science; Data visualization; Pattern mining; Social network analysis; Visual analytics
Application summary
In the current era of big data, high volumes of a wide variety of valuable data of different veracity (e.g., imprecise or uncertain data like sensor data and medical lab test results, in which the contents are uncertain due to factors like inherited measurement inaccuracies or sampling frequency) are generated or collected at a high velocity. Consequently, we are drowning in data but starving for knowledge. In order to be able to make sense of these data, data science solutions for big data mining (which discovers implicit, previously unknown & potentially useful knowledge that might be embedded in data) are in demand. Traditional algorithms mine Boolean frequent sets of items capturing only presence or absence of items in the pattern. To reflect the reality in numerous real-life applications, I propose in this research program for big pattern mining of useful patterns. In particular, I aim to discover high-utility subgraphs. These are patterns with high utility values capturing features like quantity & profit of the items in addition to the presence of the items. The subgraph captures spatial relationships among related items. To the best of my knowledge, there have not yet been works on mining high-utility subgraphs. Besides discovering from static precise data, I also plan to mine high-utility subgraphs from dynamic streams and uncertain data. This reflects the reality that we are living in an uncertain but dynamic world, where attributes of items & spatial relationships among related items can change over time. Moreover, I also plan to first visualize the distribution of these subgraphs based on their numbers of vertices and edges. I then provide users with privileges to zoom in to collections of subgraphs of their interest. This gives better interpretation of the mined high-utility subgraphs. Practicality of this visualization will be evaluated through case studies conducted on an inclusive diverse group of participants. The resulting mining system allows users to specify their interest and preference. It pushes their preference in the mining process and focus on it. This, in turn, helps users to enrich their knowledge so that they could promptly take appropriate actions or to make the best decision. It also demonstrates that this research program for big pattern mining of useful patterns-through the mining of high-utility subgraphs from real-life precise & uncertain static data, as well as dynamic streams of precise data-would have significant positive impacts on the improvement of human life and the benefits to Canadian economy.