Grant: Discovery Grants Program - Individual
University of Waterloo
$29,000.00
Foundations for Robust and Minimally-Supervised Learning Systems
EF 2023-24
Résumé
Background. Machine learning, a technology that develops software through learning from historical experience and inferencing the properties of new data by its generalization ability, has been largely driven by the availability of big data. However, labeling of big data by human annotators is costly, and machine learning generalization ability is often susceptible to adversarial attacks and out-of-distribution data. For example, a tiny adversarial patch attached to a stop sign could completely fool autopilot systems, even though the systems were trained with as many as 3-billion-mile real data collected over 6 years, quoted from Tesla's 2020 report. Objectives. The long-term goal of the proposed research program is to advance machine learning from the robustness and self-supervision perspectives, by developing generic, principled, and scalable algorithms with provable guarantees and practical applications. Therefore, the objectives include: 1) developing new robust models against unrestricted adversarial examples and out-of-distribution data and connecting robustness with fairness, privacy and interpretability towards trustworthy machine learning; 2) closing the performance gap between supervised and self-supervised learning; and 3) applying the proposed robust and self-supervised framework to the real-world tasks, including 3D reconstruction, textual analysis, and Deepfake detection. Impacts and Reward. The developed robust method is expected to serve as the first baseline to encourage the development of new defenses against a broader class of adversarial attacks. The technology will potentially accelerate the research and development of autonomous cars, making AI safe, reliable, transparent, and trustworthy in Canada. Moreover, this research will significantly reduce the cost of data labeling for high-tech companies in Canada. The proposed research program will improve the state-of-the-art of real-time 3D perception for robotics navigation, AR/VR for Metaverse, textual analysis in the presence of typos, and fake video detection on YouTube and Twitter. Students will learn the necessary skills to carry out a research plan, scientific writing, critical thinking, and coding. By the end of their program, the students will become machine learning experts who are well-positioned for industrial research scientist positions or academic research positions in top universities.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2022-03215
Name nom
Zhang, Hongyang
Department département
David R. Cheriton School of Computer Science
Organization id
33
Institution établissement
University of Waterloo
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2023
Competition year année de concours
2022
Award amount
29000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
2700
Research subject group en
Information technology
Research subject group fr
Information technology
Research subject en
Technologie de l'information
Research subject fr
Technologie de l'information
Application title
Foundations for Robust and Minimally-Supervised Learning Systems
Keyword
Adversarial Robustness; Deepfake Detection; Monocular Depth Estimation; Out-of-Distribution Generalization; Self-Supervised Learning; Textual Analysis; Trustworthy Machine Learning; Unrestricted Adversarial Examples
Application summary
Background. Machine learning, a technology that develops software through learning from historical experience and inferencing the properties of new data by its generalization ability, has been largely driven by the availability of big data. However, labeling of big data by human annotators is costly, and machine learning generalization ability is often susceptible to adversarial attacks and out-of-distribution data. For example, a tiny adversarial patch attached to a stop sign could completely fool autopilot systems, even though the systems were trained with as many as 3-billion-mile real data collected over 6 years, quoted from Tesla's 2020 report. Objectives. The long-term goal of the proposed research program is to advance machine learning from the robustness and self-supervision perspectives, by developing generic, principled, and scalable algorithms with provable guarantees and practical applications. Therefore, the objectives include: 1) developing new robust models against unrestricted adversarial examples and out-of-distribution data and connecting robustness with fairness, privacy and interpretability towards trustworthy machine learning; 2) closing the performance gap between supervised and self-supervised learning; and 3) applying the proposed robust and self-supervised framework to the real-world tasks, including 3D reconstruction, textual analysis, and Deepfake detection. Impacts and Reward. The developed robust method is expected to serve as the first baseline to encourage the development of new defenses against a broader class of adversarial attacks. The technology will potentially accelerate the research and development of autonomous cars, making AI safe, reliable, transparent, and trustworthy in Canada. Moreover, this research will significantly reduce the cost of data labeling for high-tech companies in Canada. The proposed research program will improve the state-of-the-art of real-time 3D perception for robotics navigation, AR/VR for Metaverse, textual analysis in the presence of typos, and fake video detection on YouTube and Twitter. Students will learn the necessary skills to carry out a research plan, scientific writing, critical thinking, and coding. By the end of their program, the students will become machine learning experts who are well-positioned for industrial research scientist positions or academic research positions in top universities.