Grant: Discovery Grants Program - Individual
York University
$66,000.00
Theoretical Foundations for Safe, Adaptive and Interpretable Machine Learning
FY 2023-24
Summary
The proposed research is in the area of developing theoretical foundations to machine learning. Machine learning technologies are being used in various every-day life systems with an ever growing influence on industry, science and society. This includes commercial usage such as in recommendation systems or personal devices, but also critical applications such as autonomous vehicles, brain-machine interfaces or medical assistance. As machine learning practice currently enjoys enormous success and learning methods are employed in a vast number of application domains, it becomes increasingly crucial to develop solid and formal analysis and understanding of these methods. Many of the currently most successful learning methods (in particular deep learning based ones) have a “blackbox” nature. While they are becoming enormously successful at building accurate predictors based on large amounts of data, there is a growing societal sense of discomfort about data-driven tools affecting people's lives in ever expanding, yet uncontrolled, ways. We have, in fact, distressingly little understanding on why and how these methods work, what influences their outcomes, what type of correctness guarantees one can provide for their outcomes, and how we may interpret and communicate decisions made by a machine learned system to non-experts.The long-term goal of the proposed research program is to develop a better formal understanding of requirements and methods for safe and interpretable machine learning. To start addressing this challenge, over the next few years, we plan to explore the potential of interactive machine learning for this purpose. So far, research in interactive learning has mostly focused on how to design active label queries to efficiently achieve high statistical accuracy in supervised learning tasks. Here we aim to explore the potential of active feedback loops in learning process for three other objectives:(1) Safety as machine learning technologies enter critical applications, such as self-driving cars or medical devices, we need stronger guarantees of correct behavior than the statistical guarantees we currently rely on.(2) Adaptability machine learning systems are often trained in environments that are different from the one they are employed in. Thus, we need ways to let the system adapt to such changes.(3) Interpretability as machine learned systems are used for decision support directly affecting human individuals such as in the financial sector or in the judicial system, we need to develop ways to make these decisions comprehensible by humans. To this aim, we plan to develop novel protocols of user interaction with a learning system. Developing such from a foundational perspective will help building bridges between this fast developing technology and non-experts who are using or who are affected by machine learning.
Program
Discovery Grants Program - Individual
Recipient
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
RGPIN-2018-05977
Name nom
Urner, Ruth
Department département
The Lassonde School of Engineering
Organization id
38
Institution établissement
York University
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2023
Competition year année de concours
2018
Award amount
66000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
9999
Research subject group en
Not available
Research subject group fr
Not available
Research subject en
Non disponible
Research subject fr
Non disponible
Application title
Theoretical Foundations for Safe, Adaptive and Interpretable Machine Learning
Keyword
Fairness in Machine Learning; Interpretability in Machine Learning; Safety in Machine Learning; Statistical guarantees for learning algorithms; Theory of Computer Science; Theory of Machine Learning; Transfer learning
Application summary
The proposed research is in the area of developing theoretical foundations to machine learning. Machine learning technologies are being used in various every-day life systems with an ever growing influence on industry, science and society. This includes commercial usage such as in recommendation systems or personal devices, but also critical applications such as autonomous vehicles, brain-machine interfaces or medical assistance. As machine learning practice currently enjoys enormous success and learning methods are employed in a vast number of application domains, it becomes increasingly crucial to develop solid and formal analysis and understanding of these methods. Many of the currently most successful learning methods (in particular deep learning based ones) have a “blackbox” nature. While they are becoming enormously successful at building accurate predictors based on large amounts of data, there is a growing societal sense of discomfort about data-driven tools affecting people's lives in ever expanding, yet uncontrolled, ways. We have, in fact, distressingly little understanding on why and how these methods work, what influences their outcomes, what type of correctness guarantees one can provide for their outcomes, and how we may interpret and communicate decisions made by a machine learned system to non-experts.The long-term goal of the proposed research program is to develop a better formal understanding of requirements and methods for safe and interpretable machine learning. To start addressing this challenge, over the next few years, we plan to explore the potential of interactive machine learning for this purpose. So far, research in interactive learning has mostly focused on how to design active label queries to efficiently achieve high statistical accuracy in supervised learning tasks. Here we aim to explore the potential of active feedback loops in learning process for three other objectives:(1) Safety as machine learning technologies enter critical applications, such as self-driving cars or medical devices, we need stronger guarantees of correct behavior than the statistical guarantees we currently rely on.(2) Adaptability machine learning systems are often trained in environments that are different from the one they are employed in. Thus, we need ways to let the system adapt to such changes.(3) Interpretability as machine learned systems are used for decision support directly affecting human individuals such as in the financial sector or in the judicial system, we need to develop ways to make these decisions comprehensible by humans. To this aim, we plan to develop novel protocols of user interaction with a learning system. Developing such from a foundational perspective will help building bridges between this fast developing technology and non-experts who are using or who are affected by machine learning.