Canada Spends Logo

Explorez notre analyse du budget 2026

Grant: Discovery Grants Program - Individual

Université de Montréal

$23,000.00

Optimization and game dynamics in machine learning

EF 2021-22

Résumé
This proposal focuses on the investigation of dynamics and acceleration in the context of numerical methods for optimization and games in ML. There is vast literature on optimization and specifically on optimization for machine learning (ML). However, there are a number of fundamental questions that are still unanswered. Those unanswered questions surprisingly include fundamental properties of widely used methods, the interaction of acceleration and stochasticity, the dynamics of games, and the connection between acceleration, adaptivity and generalization. A consequence of this lack of understanding is that we do not fully benefit from existing methods, and further ignore the possibility of improved methods. I am proposing fundamental research on optimization and game dynamics, as they pertain to modern challenges in machine learning and deep learning. The work includes a deeper study of classic momentum dynamics, emphasizing on some previously unknown and very curious properties; a simple approach to accelerated stochastic optimization; the study of acceleration and stochasticity on game dynamics; and an investigation of the generalization abilities of adaptive optimization methods with emphases on the lens of dynamics.
Programme
Discovery Grants Program - Individual
Emplacement
Quebec, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data

Tel que publié

Application id
RGPIN-2019-06512
Name nom
Mitliagkas, Ioannis
Department département
Department of Computer Science and Operations Research (DIRO)
Organization id
63
Institution établissement
Université de Montréal
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2021
Competition year année de concours
2019
Award amount
23000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2805
Research subject group en
Artificial intelligence
Research subject group fr
Intelligence artificielle
Research subject en
Learning and inference theories
Research subject fr
Théories de l'apprentissage et l'inférence
Installment
inst:2
Partie
1
Nb partie
5
Application title
Optimization and game dynamics in machine learning
Keyword
NSERC
Application summary
This proposal focuses on the investigation of dynamics and acceleration in the context of numerical methods for optimization and games in ML. There is vast literature on optimization and specifically on optimization for machine learning (ML). However, there are a number of fundamental questions that are still unanswered. Those unanswered questions surprisingly include fundamental properties of widely used methods, the interaction of acceleration and stochasticity, the dynamics of games, and the connection between acceleration, adaptivity and generalization. A consequence of this lack of understanding is that we do not fully benefit from existing methods, and further ignore the possibility of improved methods. I am proposing fundamental research on optimization and game dynamics, as they pertain to modern challenges in machine learning and deep learning. The work includes a deeper study of classic momentum dynamics, emphasizing on some previously unknown and very curious properties; a simple approach to accelerated stochastic optimization; the study of acceleration and stochasticity on game dynamics; and an investigation of the generalization abilities of adaptive optimization methods with emphases on the lens of dynamics.