Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Discovery Grants Program - Individual

The University of British Columbia

$33,000.00

Vector Computing with Tensor Cores and Custom Accelerators in FPGA Overlays

FY 2024-25

Summary
With all of the IoT devices and sensors, from weather monitors to accelerometers to video cameras, the world is experiencing explosive data growth. Unless the data is immediately processed into a useful enduring form, the raw logs quickly lose their value. For example, the continuous data generated by video cameras becomes nearly useless if it must be searched as raw pixels after a recording is made. Instead, it is important to process data as it is generated, recording useful metadata along with the raw data. For example, tasks like object detection, classification, and speech recognition produce useful, searchable content making future retrieval possible. To scale such systems, it is best to perform these compute-intensive tasks as close to the sensor as possible, before it reaches the data center. This research is about the design of area-efficient, possibly portable, compute accelerators and processors that can be used in edge devices and end devices. In particular, it is important to accelerate processing of raw data produced by sensors such as audio and image/video, both at the sample-level (eg, pixel processing), up to understanding interpreting and creating actionable information using techniques in audio filtering and recognition, computer vision, and artificial intelligence. Accelerating frameworks already popular with users, such as OpenCV, TensorFlow and PyTorch, is most important. In pursuing the design of such accelerators and their programming systems, this research leverage the PI's experience in vector processors, FPGA overlays, neural network accelerators, and CAD tools. Past research has produced 4 generations of different vector processor architectures, where each generation was fully functional and implemented in FPGAs. The latest generation, VectorBlox MXP, was the foundation for a startup company that was purchased by a world-leading vendor of processors and FPGAs. The PI has also been an active participant in the development of the RISC-V processor extensions for vector processing and cache management. This research will continue the work by developing a complete processor and compute accelerator ecosystems, starting from the RISC-V specification and lessons learned with MXP. This accelerator will be vector-based, but generalized to support more parallelism using tensor cores, custom compute units, and better support for MIMD-style and pipeline parallelism. Leveraging the familiar tools of Python, LLVM and Linux, the research create new programming support systems, languages, and compilers to generate code for the new accelerators produced as FPGA overlays. Some parts of the hardware system will be auto-generated from techniques such as high-level synthesis, while others will be manually built. The end result will be easy-to-program systems that achieve high performance through effective use of parallelism.
Program
Discovery Grants Program - Individual
Location
British Columbia, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
RGPIN-2022-05377
Name nom
Lemieux, Guy
Department département
Electrical and Computer Engineering
Organization id
2
Institution établissement
The University of British Columbia
Province en
British Columbia
Province fr
Colombie-Britannique
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2024
Competition year année de concours
2022
Award amount
33000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1510
Committee name en
Electrical and Computer Engineering
Committee name fr
Génie électrique et informatique
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
2719
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Computer architecture and design
Research subject fr
Architecture d'ordinateur et conception
Field of research list names en
Not available
Field of research list names fr
Non disponible
Socioeconomic objective list names en
Not available
Socioeconomic objective list names fr
Non disponible
Application title
Vector Computing with Tensor Cores and Custom Accelerators in FPGA Overlays
Keywords
reconfigurable computing; fpgas; computer architecture; vector processing; application-specific processors; compute accelerators; fpga overlays; computer vision; machine learning; artificial intelligence
Application summary
With all of the IoT devices and sensors, from weather monitors to accelerometers to video cameras, the world is experiencing explosive data growth. Unless the data is immediately processed into a useful enduring form, the raw logs quickly lose their value. For example, the continuous data generated by video cameras becomes nearly useless if it must be searched as raw pixels after a recording is made. Instead, it is important to process data as it is generated, recording useful metadata along with the raw data. For example, tasks like object detection, classification, and speech recognition produce useful, searchable content making future retrieval possible. To scale such systems, it is best to perform these compute-intensive tasks as close to the sensor as possible, before it reaches the data center. This research is about the design of area-efficient, possibly portable, compute accelerators and processors that can be used in edge devices and end devices. In particular, it is important to accelerate processing of raw data produced by sensors such as audio and image/video, both at the sample-level (eg, pixel processing), up to understanding interpreting and creating actionable information using techniques in audio filtering and recognition, computer vision, and artificial intelligence. Accelerating frameworks already popular with users, such as OpenCV, TensorFlow and PyTorch, is most important. In pursuing the design of such accelerators and their programming systems, this research leverage the PI's experience in vector processors, FPGA overlays, neural network accelerators, and CAD tools. Past research has produced 4 generations of different vector processor architectures, where each generation was fully functional and implemented in FPGAs. The latest generation, VectorBlox MXP, was the foundation for a startup company that was purchased by a world-leading vendor of processors and FPGAs. The PI has also been an active participant in the development of the RISC-V processor extensions for vector processing and cache management. This research will continue the work by developing a complete processor and compute accelerator ecosystems, starting from the RISC-V specification and lessons learned with MXP. This accelerator will be vector-based, but generalized to support more parallelism using tensor cores, custom compute units, and better support for MIMD-style and pipeline parallelism. Leveraging the familiar tools of Python, LLVM and Linux, the research create new programming support systems, languages, and compilers to generate code for the new accelerators produced as FPGA overlays. Some parts of the hardware system will be auto-generated from techniques such as high-level synthesis, while others will be manually built. The end result will be easy-to-program systems that achieve high performance through effective use of parallelism.