Grant: Discovery Grants Program - Individual
Université de Montréal
$50,000.00
Robust and Efficient Structured Prediction
EF 2022-23
Résumé
Machine learning is widely used in science and technology with deployed tools like automatic spam classification for emails or face detectors in digital cameras. Yet today's partial solutions to the fundamental problem of structured prediction, that is, learning to make multiple interrelated predictions (e.g. predicting the sequence of translated words for an input sentence in machine translation), lag far behind those available for binary classification in term of accuracy and scalability. Progress has been fragmented, and the theory is almost nonexistent, preventing the widespread adoption of the technology to new areas. The key challenge in structured prediction is the combinatorial explosion of choices for the output, requiring a radical new marriage of computation and statistics.The objective of this research program is to elaborate a general theoretical and algorithmic framework for robust and efficient structured prediction. The goal is to bring structured prediction to a level of maturity and usability similar to that of binary classification in modern machine learning. I plan to attack this problem through the tools of statistical consistency of surrogate losses. Our theoretical work will provide the groundwork to build new robust structured prediction models that can handle weak supervision. Radically more efficient structured prediction machines will be obtained through our algorithmic work on advanced convex and combinatorial optimization. The applicability of the framework will be demonstrated through applications in computer vision, natural language processing and computational biology.More specifically, my research program will address the following four scientific challenges:1) Provide a unified theoretical analysis of structured prediction models.2) Propose novel structured prediction models that enjoy good theoretical properties, are tractable, and address the particularities of the field such as weak supervision.3) Design efficient algorithms that solve the underlying large-scale convex or non-convex optimization problems.4) Demonstrate the applicability of the framework in several application areas.Breakthrough progress on structured prediction will have high impact on statistical machine learning research, notably by providing a new solution to the open problem of making robust interrelated predictions. Moreover, the developed methodology will directly impact numerous application areas in science and technology by enabling the widespread adoption of advanced structured prediction.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Quebec, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2017-06936
Name nom
Lacoste-Julien, Simon
Department département
Informatique et recherche opérationnelle - Informatique et recherche opérationnelle
Organization id
63
Institution établissement
Université de Montréal
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2022
Competition year année de concours
2017
Award amount
50000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
2800
Research subject group en
Artificial intelligence
Research subject group fr
Intelligence artificielle
Research subject en
Artificial intelligence (computer vision, use2603)
Research subject fr
Intelligence artificielle (vision artificielle, utiliser 2603)
Installment
inst:6;7
Partie
2
Nb partie
7
Application title
Robust and Efficient Structured Prediction
Application summary
Machine learning is widely used in science and technology with deployed tools like automatic spam classification for emails or face detectors in digital cameras. Yet today's partial solutions to the fundamental problem of structured prediction, that is, learning to make multiple interrelated predictions (e.g. predicting the sequence of translated words for an input sentence in machine translation), lag far behind those available for binary classification in term of accuracy and scalability. Progress has been fragmented, and the theory is almost nonexistent, preventing the widespread adoption of the technology to new areas. The key challenge in structured prediction is the combinatorial explosion of choices for the output, requiring a radical new marriage of computation and statistics.The objective of this research program is to elaborate a general theoretical and algorithmic framework for robust and efficient structured prediction. The goal is to bring structured prediction to a level of maturity and usability similar to that of binary classification in modern machine learning. I plan to attack this problem through the tools of statistical consistency of surrogate losses. Our theoretical work will provide the groundwork to build new robust structured prediction models that can handle weak supervision. Radically more efficient structured prediction machines will be obtained through our algorithmic work on advanced convex and combinatorial optimization. The applicability of the framework will be demonstrated through applications in computer vision, natural language processing and computational biology.More specifically, my research program will address the following four scientific challenges:1) Provide a unified theoretical analysis of structured prediction models.2) Propose novel structured prediction models that enjoy good theoretical properties, are tractable, and address the particularities of the field such as weak supervision.3) Design efficient algorithms that solve the underlying large-scale convex or non-convex optimization problems.4) Demonstrate the applicability of the framework in several application areas.Breakthrough progress on structured prediction will have high impact on statistical machine learning research, notably by providing a new solution to the open problem of making robust interrelated predictions. Moreover, the developed methodology will directly impact numerous application areas in science and technology by enabling the widespread adoption of advanced structured prediction.