Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Discovery Grants Program - Individual

University of Toronto

$46,000.00

High-Performance Hardware-Accelerated Private Computation

FY 2023-24

Summary
Fully homomorphic encryption (FHE) is a way of encrypting data that enables users to perform an arbitrary sequence of operations, such as addition or multiplication, on the data without having to decrypt to do so. The capacity to compute on encrypted data is extremely useful, as it allows for services to be performed on sensitive personal data on an untrusted cloud-based machine without ever compromising either the security or privacy of the data during. Performing the mathematical operations using the underlying lattice-based mathematics uses a great deal of compute time and memory. Until now, these computational costs have held back FHE technology from practical use in many large-scale, real-world applications.  Breaking through this compute cost barrier is the core research challenge addressed by the proposed research program. Many different mathematical foundations have been used and are in development to realize FHE at greater computational efficiencies. A common technique to accelerate an FHE scheme is to encrypt multiple bits of data or operands simultaneously into a single polynomial used, or to utilize parallel computational hardware that exploits the inherent mathematical structure found in FHE matrix algebra operations. Both graphic processing units (GPUs) and field-programmable gate arrays (FPGAs) have been used as hardware platforms to accelerate FHE schemes in these ways. Challenges exist for each of these hardware platforms. For example, encrypted data requires significantly more memory storage and bandwidth than plaintext data, to the point where it easily exceeds the capabilities of off-the-shelf FPGAs in high-performance applications. Single-purpose, dedicated, hardware accelerators for FHE as realized by state-of-the-art CMOS system-on-chip (SoC) technologies will provide greatly accelerated performance enabling widespread enterprise-scale applications. An important application of FHE that has not yet been optimized for hardware-based acceleration is the implementation of kernel logistic regression machine learning models for very large multi-dimensional data sets. Kernel logistic regression is a classification technique which, given a set of inputs, calculates the probability that the input belongs to a certain class as defined by a complex decision surface.  This operation is key to many machine learning applications.  The goal of this research program is identify scalable, VLSI hardware acceleration architectures and circuits that can reduce the execution time taken to run machine learning inference models on encrypted data by two orders of magnitude, enabling machine learning problems that currently take hours to be solved in minutes. If this is achieved, it would pave the way for widespread implementation of secure, private, cost-effective, cloud-based FHE implementations of machine learning models that guarantee the security and privacy of the data, the models and the inferences generated.
Program
Discovery Grants Program - Individual
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
RGPIN-2020-05807
Name nom
Gulak, Glenn
Department département
Electrical & Computer Engineering - Electrical & Computer Engineering
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2023
Competition year année de concours
2020
Award amount
46000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1510
Committee name en
Electrical and Computer Engineering
Committee name fr
Génie électrique et informatique
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2722
Research subject group en
Information technology
Research subject group fr
Vlsi systems
Research subject en
Technologie de l'information
Research subject fr
Systèmes intégrés à très grande échelle (VLSI)
Application title
High-Performance Hardware-Accelerated Private Computation
Keyword
Cloud Computing; Computer Architecture; Fully Homomorphic Encryption; GPU / VLSI; Hardware Acceleration; Lattice Encryption Techniques; Machine Learning; Parallel Algorithms; Private Computation; System on Chip (SoC)
Application summary
Fully homomorphic encryption (FHE) is a way of encrypting data that enables users to perform an arbitrary sequence of operations, such as addition or multiplication, on the data without having to decrypt to do so. The capacity to compute on encrypted data is extremely useful, as it allows for services to be performed on sensitive personal data on an untrusted cloud-based machine without ever compromising either the security or privacy of the data during. Performing the mathematical operations using the underlying lattice-based mathematics uses a great deal of compute time and memory. Until now, these computational costs have held back FHE technology from practical use in many large-scale, real-world applications.  Breaking through this compute cost barrier is the core research challenge addressed by the proposed research program. Many different mathematical foundations have been used and are in development to realize FHE at greater computational efficiencies. A common technique to accelerate an FHE scheme is to encrypt multiple bits of data or operands simultaneously into a single polynomial used, or to utilize parallel computational hardware that exploits the inherent mathematical structure found in FHE matrix algebra operations. Both graphic processing units (GPUs) and field-programmable gate arrays (FPGAs) have been used as hardware platforms to accelerate FHE schemes in these ways. Challenges exist for each of these hardware platforms. For example, encrypted data requires significantly more memory storage and bandwidth than plaintext data, to the point where it easily exceeds the capabilities of off-the-shelf FPGAs in high-performance applications. Single-purpose, dedicated, hardware accelerators for FHE as realized by state-of-the-art CMOS system-on-chip (SoC) technologies will provide greatly accelerated performance enabling widespread enterprise-scale applications. An important application of FHE that has not yet been optimized for hardware-based acceleration is the implementation of kernel logistic regression machine learning models for very large multi-dimensional data sets. Kernel logistic regression is a classification technique which, given a set of inputs, calculates the probability that the input belongs to a certain class as defined by a complex decision surface.  This operation is key to many machine learning applications.  The goal of this research program is identify scalable, VLSI hardware acceleration architectures and circuits that can reduce the execution time taken to run machine learning inference models on encrypted data by two orders of magnitude, enabling machine learning problems that currently take hours to be solved in minutes. If this is achieved, it would pave the way for widespread implementation of secure, private, cost-effective, cloud-based FHE implementations of machine learning models that guarantee the security and privacy of the data, the models and the inferences generated.