Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Engage Grants Program

McGill University

$24,709.00

Scalable NoSQL-based architecture for media monitoring data

FY 2013-14

Summary
Gnowit Inc., our industry partner, deploys a NoSQL key-value store as an advanced main-memoryinfrastructure that facilitates fast access to frequently accessed data. So far, its storage needs are relatively smallwith one storage server being sufficient. However, within the next year it envisions an 20-fold increase in itsprocessing and storage requirements as it currently explores new markets requiring to considerably scale-uptheir configuration and make it reliable. Unfortunately, general purpose solutions to achieve scalability andreliability do not take the characteristics of the particular application workload of Gnowit into account. Forexample, an attempt to combine a fast key-value main-memory store with a general-purpose relational databasesystem as backend tier has quickly led to the database being the bottleneck and not offering the requestedperformance in terms of response times.The goal of this research is to develop a reliable, efficient and scalable data storage infrastructure for ourindustrial partner based on NoSQL technology that is optimized for its particular query and update needs. Theindustrial partner processes large number of data accesses to individual data items in lists whose keys areURLs. Based on these needs we will develop and apply a hybrid key-value store that provides both fastmain-memory access as well as fast disk-based storage. Both loosely-coupled as well as tightly-coupledsystems will be analyzed. As well, we will integrate specific index structures into the storage hierarchy that canefficiently handle the particular data structures used by our industry partner.
Program
Engage Grants Program
Location
Quebec, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
452476-2013
Name nom
Kemme, Bettina
Department département
Computer Science, School of
Organization id
61
Institution établissement
McGill University
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2013
Competition year année de concours
2013
Award amount
24709
Program id
EGP
Program name en
Engage Grants Program
Program name fr
Programme de subventions d'engagement partenariat
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
1552
Committee name en
Quebec Internal Decision Committee
Committee name fr
Comité de décision interne pour le Québec
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2711
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Database management
Research subject fr
Gestion de bases de données
Partie
1
Nb partie
1
Application title
Scalable NoSQL-based architecture for media monitoring data
Keyword
NSERC
Application summary
Gnowit Inc., our industry partner, deploys a NoSQL key-value store as an advanced main-memoryinfrastructure that facilitates fast access to frequently accessed data. So far, its storage needs are relatively smallwith one storage server being sufficient. However, within the next year it envisions an 20-fold increase in itsprocessing and storage requirements as it currently explores new markets requiring to considerably scale-uptheir configuration and make it reliable. Unfortunately, general purpose solutions to achieve scalability andreliability do not take the characteristics of the particular application workload of Gnowit into account. Forexample, an attempt to combine a fast key-value main-memory store with a general-purpose relational databasesystem as backend tier has quickly led to the database being the bottleneck and not offering the requestedperformance in terms of response times.The goal of this research is to develop a reliable, efficient and scalable data storage infrastructure for ourindustrial partner based on NoSQL technology that is optimized for its particular query and update needs. Theindustrial partner processes large number of data accesses to individual data items in lists whose keys areURLs. Based on these needs we will develop and apply a hybrid key-value store that provides both fastmain-memory access as well as fast disk-based storage. Both loosely-coupled as well as tightly-coupledsystems will be analyzed. As well, we will integrate specific index structures into the storage hierarchy that canefficiently handle the particular data structures used by our industry partner.