Grant: Discovery Grants Program - Individual
University of Alberta
$42,000.00
Interactive online learning
EF 2016-17
Résumé
Humans acquire most of their advanced sensing and acting capabilities by learning. The idea of the field of machine learning is to give computers similar learning capabilities so that through learning they can overcome the limitations imposed by our lack of understanding of how to solve complex tasks. Applications of machine learning algorithms abound. In our daily lives, machine learning algorithms help us by allowing us to speak to our phones, by filtering out e-mail spam, by translating documents, or by recognizing faces, either for security reasons or to label our friends on social networks. The above are examples of one-shot prediction problems, where the effect of a decision does not have long term impact. However, in many applications this is not the case. For example, the decision of what content to put on the frontpage of a web portal will limit the information received about the preferences of the website's visitors: Simply, no feedback will be available about content that is not shown. Thus, the decision maker has to reason about the impact of losing information as a result of his decisions. In other situations, such as choosing a profession, decisions made today influence what opportunities arise in the future. My research focuses on exploring how machine learning can be used in these interactive scenarios. My goal is to build algorithms that can handle problems of greater size and complexity than previously feasible. The strategy I employ is to study special cases first, as this allows me to identify and address fundamental issues in isolation, which eventually leads to more efficient algorithms capable of addressing more complex problems. For example, recently, using this technique, I made progress on developing algorithms that explicitly reason about the ""value of information"" in a provably optimal manner. This work is expected to achieve broad impact by extending the scope of applicability of current machine learning methods to the ubiquitous interactive learning settings.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Alberta, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
341723-2012
Name nom
Szepesvari, Csaba
Department département
Computing Science
Organization id
9
Institution établissement
University of Alberta
Province en
Alberta
Province fr
Alberta
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2016
Competition year année de concours
2012
Award amount
42000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
1205
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Mathematical sciences
Area of application fr
Sciences mathématiques
Research subject code
2805
Research subject group en
Artificial intelligence
Research subject group fr
Intelligence artificielle
Research subject en
Learning and inference theories
Research subject fr
Théories de l'apprentissage et l'inférence
Partie
5
Nb partie
5
Application title
Interactive online learning
Keyword
NSERC
Application summary
Humans acquire most of their advanced sensing and acting capabilities by learning. The idea of the field of machine learning is to give computers similar learning capabilities so that through learning they can overcome the limitations imposed by our lack of understanding of how to solve complex tasks. Applications of machine learning algorithms abound. In our daily lives, machine learning algorithms help us by allowing us to speak to our phones, by filtering out e-mail spam, by translating documents, or by recognizing faces, either for security reasons or to label our friends on social networks. The above are examples of one-shot prediction problems, where the effect of a decision does not have long term impact. However, in many applications this is not the case. For example, the decision of what content to put on the frontpage of a web portal will limit the information received about the preferences of the website's visitors: Simply, no feedback will be available about content that is not shown. Thus, the decision maker has to reason about the impact of losing information as a result of his decisions. In other situations, such as choosing a profession, decisions made today influence what opportunities arise in the future. My research focuses on exploring how machine learning can be used in these interactive scenarios. My goal is to build algorithms that can handle problems of greater size and complexity than previously feasible. The strategy I employ is to study special cases first, as this allows me to identify and address fundamental issues in isolation, which eventually leads to more efficient algorithms capable of addressing more complex problems. For example, recently, using this technique, I made progress on developing algorithms that explicitly reason about the ""value of information"" in a provably optimal manner. This work is expected to achieve broad impact by extending the scope of applicability of current machine learning methods to the ubiquitous interactive learning settings.