Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Alliance Grants

McGill University

$25,000.00

Overload protection in mobile edge computing using multi-agent reinforcement learning

FY 2021-22

Summary
In recent years, there has been a proliferation of computationally intensive smartphone applications such as real-time online gaming, video-on-demand, augmented and virtual reality applications, etc. Due to the high computational demand, these services are often moved to what are called Edge Servers using a paradigm known as Mobile Edge Computing (MEC).To ensure the reliability of a MEC cluster, it is important to prevent overloading of the servers. Such server overloading can be prevented by pre-emptively offloading the requests and routing them to other servers or completely dropping them. In this project, we propose to develop new theories and algorithms to improve job offloading and routing policies using multi-agent reinforcement learning (MARL).Specifically, we will: (i) develop a multi-agent multi-stage optimization problem based mathematical model for multi-server MEC clusters; (ii) identify pertinent qualitative properties of optimal admission control and routing policies; (iii) develop low-complexity MARL algorithms which exploit the qualitative properties derived in the previous step; and (iv) perform a detailed simulation-based study to evaluate the performance of the proposed algorithms in real-world settings. It is anticipated that the project will lead to future publications in top-tier conferences and journals.
Program
Alliance Grants
Location
Quebec, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
571054-2021
Name nom
Mahajan, Aditya
Department département
Electrical and Computer Engineering
Organization id
61
Institution établissement
McGill University
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2021
Competition year année de concours
2021
Award amount
25000
Program id
ALLRP
Program name en
Alliance Grants
Program name fr
Subventions Alliance
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
96
Committee name en
RPP Internal Decision Cttee
Committee name fr
Cté de décision interne - PPR
Area of application code
9999
Area of application group en
Not available
Area of application group fr
Non disponible
Area of application en
Not available
Area of application fr
Non disponible
Research subject code
2508
Research subject group en
Electrical and electronic engineering
Research subject group fr
Génie électrique et électronique
Research subject en
Communications networks
Research subject fr
Réseaux de télécommunications
Installment
inst:1
Partie
1
Nb partie
1
Application title
Overload protection in mobile edge computing using multi-agent reinforcement learning
Keyword
NSERC
Application summary
In recent years, there has been a proliferation of computationally intensive smartphone applications such as real-time online gaming, video-on-demand, augmented and virtual reality applications, etc. Due to the high computational demand, these services are often moved to what are called Edge Servers using a paradigm known as Mobile Edge Computing (MEC).To ensure the reliability of a MEC cluster, it is important to prevent overloading of the servers. Such server overloading can be prevented by pre-emptively offloading the requests and routing them to other servers or completely dropping them. In this project, we propose to develop new theories and algorithms to improve job offloading and routing policies using multi-agent reinforcement learning (MARL).Specifically, we will: (i) develop a multi-agent multi-stage optimization problem based mathematical model for multi-server MEC clusters; (ii) identify pertinent qualitative properties of optimal admission control and routing policies; (iii) develop low-complexity MARL algorithms which exploit the qualitative properties derived in the previous step; and (iv) perform a detailed simulation-based study to evaluate the performance of the proposed algorithms in real-world settings. It is anticipated that the project will lead to future publications in top-tier conferences and journals.