Grant: Strategic Projects Supplemental Competition
University of Toronto
$96,000.00
Snowflock: virtual machine framework for parallel and data intensive computing
EF 2008-09
Résumé
The sequencing of dozens of genomes, determination of the structure of thousands of proteins and various
novel experimental techniques that provide information about all genes in an organism have transformed
biology into an information-driven science. Bioinformaticians are developing applications that interact with
terabyte-sized datasets, yet their users are constrained by the inability to purchase and maintain the equipment
necessary to use these applications. This proposal introduces a novel paradigm that leverages virtual machine
(VM) technology to revolutionize the way in which data- and compute- intensive applications in general, and
bioinformatics tools in particular, are provided to scientists and engineers. In the new paradigm, large datasets
are stored on resource provided by a service provider, and applications encapsulated inside VMs migrate to the
provider to be close to the data. Moreover we take advantage of cluster computing by forking multiple copies
of a VM, which then execute independently on different physical hosts and disappear upon the completion of
the necessary computation. We will implement this novel paradigm in the Snowflock package, which will
combine efficient VM replication and scheduling with powerful data-access routines, and an API and
distribution specifically designed for bioinformatics. We believe that by combining the benefits of
parallelization with the strengths of VM technology, Snowflock will make high performance applications
accessible to a much broader community of scientists and engineers.
Programme
Strategic Projects Supplemental Competition
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
356747-2007
Name nom
DeLara, Eyal
Department département
Computer Science
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2008
Competition year année de concours
2007
Award amount
96000
Program id
STPSC
Program nane en
Strategic Projects Supplemental Competition
Program name fr
Projets stratégiques compétition supplémentaire
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
1064
Committee name en
Strategic Advanced Communications and Management of Information 1
Committee name fr
Stratégique -Technologies avancées de communication et de gestion de l'information 1
Area of application code
801
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Computer software
Area of application fr
Logiciel
Research subject code
2720
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Computer systems software
Research subject fr
Logiciel de systèmes informatiques
Partie
2
Nb partie
2
Application title
Snowflock: virtual machine framework for parallel and data intensive computing
Keyword
NA
Application summary
The sequencing of dozens of genomes, determination of the structure of thousands of proteins and various
novel experimental techniques that provide information about all genes in an organism have transformed
biology into an information-driven science. Bioinformaticians are developing applications that interact with
terabyte-sized datasets, yet their users are constrained by the inability to purchase and maintain the equipment
necessary to use these applications. This proposal introduces a novel paradigm that leverages virtual machine
(VM) technology to revolutionize the way in which data- and compute- intensive applications in general, and
bioinformatics tools in particular, are provided to scientists and engineers. In the new paradigm, large datasets
are stored on resource provided by a service provider, and applications encapsulated inside VMs migrate to the
provider to be close to the data. Moreover we take advantage of cluster computing by forking multiple copies
of a VM, which then execute independently on different physical hosts and disappear upon the completion of
the necessary computation. We will implement this novel paradigm in the Snowflock package, which will
combine efficient VM replication and scheduling with powerful data-access routines, and an API and
distribution specifically designed for bioinformatics. We believe that by combining the benefits of
parallelization with the strengths of VM technology, Snowflock will make high performance applications
accessible to a much broader community of scientists and engineers.