Grant: Discovery Grants Program - Individual
York University
$29,000.00
HAINEM: Hardware Software Co-Design Solutions for Ultra-Efficient Artificial Intelligence and Neuromorphic Systems by Using Emerging Memory Technologies
FY 2024-25
Summary
Conventional computing platforms, specially von-Neumann-based computing architectures, are seriously suffering from the limited data bandwidth between processing units and memory which makes them incompatible for big data processing and implementing state-of-the-art machine learning (ML) algorithms with extensive large sets of parameters. The HAINEM program will propose the hardware software co-design solutions to develop ultra-efficient specialized computing platforms for artificial intelligence (AI) applications. In this program, we deploy the intrinsic behaviour of emerging resistive switching (RS) memory technology devices by collocating memory and processing to enable compute-in-memory (CIM) and resolve the data communication problem known as memory wall. We will develop beyond von-Neumann application processing units (APUs) to accelerate ML algorithms and mitigating the hardware non-idealities by leveraging hardware software co-design solutions. HAINEM will investigate new networks and reframe existing machine learning problems into more compatible algorithms for the proposed APUs.
HAINEM's very first milestone is to develop the edge ML hardware to improve computational efficiency (defined as TOPs/mm2) and energy efficiency (defined as TOPS/W) by getting the advantage from fully parallel analog VMM in RS-based crossbar accelerators. It aims to develop next generation ML hardware which could be embedded into the edge, near the front-end sensors networks, to process signals directly without sending them toward the cloud. This program will also focus on neuromorphic computing concepts inspired from the most efficient computing system, human brain, to further enhance the efficiency toward a more parallel, low-power, and robust computing platform through spiking neural network (SNN) structure. In HAINEM, we show how RS-based systems mimic functional primitives in SNN and can reproduce synaptic and neuronal models like learning behaviours as biological synapses in our brain such as long term depression (LTD) and long term potentiation (LTP). We will also explore different emerging RS memory devices as synaptic connections and will test various bio-inspired learning mechanisms over these synaptic devices like pair-based and triplet-based spike-time-dependant plasticity (STDP). HAINEM also try to develop more efficient RS based neuronal circuit by using mixed-signal circuit design concepts. Finally, our goal is to design fully functional neuromorphic architectures on chip and proof of concept will show the implementation of near-sensor computing applications such as EEG seizure detection, EEG-based brain state identification, retina data processing. HAINEM will be an important research program which helps Canada and Toronto to become a major research and development hub for hardware implementation for AI and neuromorphic computing in strong synergy with Ontario's world-class expertise in software-based neural networks.
Program
Discovery Grants Program - Individual
Recipient
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
RGPIN-2022-04489
Name nom
Amirsoleimani, Amirali
Department département
Electrical engineering and Computer Science
Organization id
38
Institution établissement
York University
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2024
Competition year année de concours
2022
Award amount
29000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1510
Committee name en
Electrical and Computer Engineering
Committee name fr
Génie électrique et informatique
Area of application code
1102
Area of application group en
Health, education and social services
Area of application group fr
Santé publique, éducation et services sociaux
Area of application en
Biomedical engineering
Area of application fr
Génie biomédical
Research subject code
2504
Research subject group en
Electrical and electronic engineering
Research subject group fr
Génie électrique et électronique
Research subject en
Integrated circuits
Research subject fr
Circuits intégrés
Field of research list names en
Not available
Field of research list names fr
Non disponible
Socioeconomic objective list names en
Not available
Socioeconomic objective list names fr
Non disponible
Application title
HAINEM: Hardware Software Co-Design Solutions for Ultra-Efficient Artificial Intelligence and Neuromorphic Systems by Using Emerging Memory Technologies
Keywords
artificial intelligence hardware; hardware/software co-design; emerging memory technology; mixed-signal circuits; neuromorphic computing; bio-inspired computing; application processing unit; hardware accelerators
Application summary
Conventional computing platforms, specially von-Neumann-based computing architectures, are seriously suffering from the limited data bandwidth between processing units and memory which makes them incompatible for big data processing and implementing state-of-the-art machine learning (ML) algorithms with extensive large sets of parameters. The HAINEM program will propose the hardware software co-design solutions to develop ultra-efficient specialized computing platforms for artificial intelligence (AI) applications. In this program, we deploy the intrinsic behaviour of emerging resistive switching (RS) memory technology devices by collocating memory and processing to enable compute-in-memory (CIM) and resolve the data communication problem known as memory wall. We will develop beyond von-Neumann application processing units (APUs) to accelerate ML algorithms and mitigating the hardware non-idealities by leveraging hardware software co-design solutions. HAINEM will investigate new networks and reframe existing machine learning problems into more compatible algorithms for the proposed APUs.
HAINEM's very first milestone is to develop the edge ML hardware to improve computational efficiency (defined as TOPs/mm2) and energy efficiency (defined as TOPS/W) by getting the advantage from fully parallel analog VMM in RS-based crossbar accelerators. It aims to develop next generation ML hardware which could be embedded into the edge, near the front-end sensors networks, to process signals directly without sending them toward the cloud. This program will also focus on neuromorphic computing concepts inspired from the most efficient computing system, human brain, to further enhance the efficiency toward a more parallel, low-power, and robust computing platform through spiking neural network (SNN) structure. In HAINEM, we show how RS-based systems mimic functional primitives in SNN and can reproduce synaptic and neuronal models like learning behaviours as biological synapses in our brain such as long term depression (LTD) and long term potentiation (LTP). We will also explore different emerging RS memory devices as synaptic connections and will test various bio-inspired learning mechanisms over these synaptic devices like pair-based and triplet-based spike-time-dependant plasticity (STDP). HAINEM also try to develop more efficient RS based neuronal circuit by using mixed-signal circuit design concepts. Finally, our goal is to design fully functional neuromorphic architectures on chip and proof of concept will show the implementation of near-sensor computing applications such as EEG seizure detection, EEG-based brain state identification, retina data processing. HAINEM will be an important research program which helps Canada and Toronto to become a major research and development hub for hardware implementation for AI and neuromorphic computing in strong synergy with Ontario's world-class expertise in software-based neural networks.