Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Collaborative Research and Development Grants

University of Toronto

$68,000.00

JIT as a Service

FY 2019-20

Summary
The Just-In-Time (JIT) compiler used in the Java Virtual Machine (JVM) improves performance of Java applications, but adds significant overhead in terms of processing power and memory footprint. This additional memory footprint is usually a few hundreds of megabytes in the general case and can be a significant proportion of the overall memory footprint taken by a Java process for a simple application such as a Java microservice. These overheads are especially important in a cloud environment which tries to maximize resource utilization and increase application density, as well as in emerging edge and fog computing applications involving resource-constrained clients, such as sensors and other embedded devices. JIT-as-a-Service (JITaaS) offers a novel way of compiling Java bytecode at runtime by moving the JIT compilation component to a remote process and offering it as a service, in the cloud. JITaaS allows client JVMs that connect to the compilation service to function without the additional memory footprint and CPU overhead that a compiler operating ""in process"" would bring with it.This proposal is a joint effort between researchers at the University of Toronto and IBM. JITaaS is an important pillar for IBM's cloud optimization strategy for Java. JITaaS was devised as a solution in order for Java to be competitive with other languages such as Go or Swift that are not dynamically compiled while still retaining the benefits of being a dynamically compiled language. Unfortunately, given the latency of network communication to a JIT server in the cloud and (especially) on the edge, JIT-compiling the user code while meeting user expectations for low latency is a challenge.This project addresses this challenge by conducting research along the following dimensions: (i) reducing the overhead for communication between the client and the JIT server; (ii) sharing previously compiled code between clients; (iii) predicting application access patterns to prefetch compiled code; (iv) predicting changes in application usage patterns that require code recompilation.
Program
Collaborative Research and Development Grants
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
543883-2019
Name nom
DeLara, Eyal
Department département
Computer Science (St. George Campus)
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2019
Competition year année de concours
2019
Award amount
68000
Program id
CRDPJ
Program name en
Collaborative Research and Development Grants
Program name fr
Subventions de recherche et développement coopérative
Group en
RESEARCH PARTNERSHIPS
Group fr
PARTENARIATS DE RECHERCHE
Committee code
96
Committee name en
RPP Internal Decision Cttee
Committee name fr
Cté de décision interne - PPR
Area of application code
801
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Computer software
Area of application fr
Logiciel
Research subject code
2720
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Computer systems software
Research subject fr
Logiciel de systèmes informatiques
Installment
inst:1 - 1
Partie
1
Nb partie
1
Application title
JIT as a Service
Keyword
NSERC
Application summary
The Just-In-Time (JIT) compiler used in the Java Virtual Machine (JVM) improves performance of Java applications, but adds significant overhead in terms of processing power and memory footprint. This additional memory footprint is usually a few hundreds of megabytes in the general case and can be a significant proportion of the overall memory footprint taken by a Java process for a simple application such as a Java microservice. These overheads are especially important in a cloud environment which tries to maximize resource utilization and increase application density, as well as in emerging edge and fog computing applications involving resource-constrained clients, such as sensors and other embedded devices. JIT-as-a-Service (JITaaS) offers a novel way of compiling Java bytecode at runtime by moving the JIT compilation component to a remote process and offering it as a service, in the cloud. JITaaS allows client JVMs that connect to the compilation service to function without the additional memory footprint and CPU overhead that a compiler operating ""in process"" would bring with it.This proposal is a joint effort between researchers at the University of Toronto and IBM. JITaaS is an important pillar for IBM's cloud optimization strategy for Java. JITaaS was devised as a solution in order for Java to be competitive with other languages such as Go or Swift that are not dynamically compiled while still retaining the benefits of being a dynamically compiled language. Unfortunately, given the latency of network communication to a JIT server in the cloud and (especially) on the edge, JIT-compiling the user code while meeting user expectations for low latency is a challenge.This project addresses this challenge by conducting research along the following dimensions: (i) reducing the overhead for communication between the client and the JIT server; (ii) sharing previously compiled code between clients; (iii) predicting application access patterns to prefetch compiled code; (iv) predicting changes in application usage patterns that require code recompilation.