Grant: Discovery Grants Program - Individual
Université du Québec à Montréal
$35,000.00
Addressing jointly privacy and ethical issues in responsible machine learning
EF 2023-24
Résumé
The success of Machine Learning (ML) models is such that they are now ubiquitous in our society, which raises serious privacy and ethical issues (e.g., fairness and explainability), especially if their predictions are put into action in domains in which they can significantly affect individuals. There is a huge scientific literature that has studied in isolation, the concepts of privacy, fairness and interpretability in ML. However, very few works have explored the tensions, but also convergences, that emerge when addressing jointly these issues when designing and deploying ML models. The scope of my research program aims at answering this question by investigating when the achievement of these different objectives results in a positive sum game as well as the situations in which they conflict with each other, and a trade-off needs to be set. First, with respect to the intersection between privacy and fairness, the main challenge is to design fair models without collecting unnecessary sensitive attributes and while preventing privacy attacks on the training data or on the model. For example, I envision to adapt techniques coming from privacy such as anonymization mechanisms as well as data synthetization methods to also integrate fairness. Second, in the interactions between privacy and explainability, one of the main points of tension is that providing explanations necessarily reveal more information than simply outputting the prediction of the model. In this research direction, I propose to investigate which types of post hoc explanations among the existing ones offer the best robustness against privacy attacks. In addition of developing countermeasures to limit the success of such attacks, I will explore which families of interpretable models (e.g., linear models, decision trees or rule lists) offer the best protection against inference attacks. Third, at the crossings of fairness and explainability, I will work on the design of quantitative methods for evaluating the fairwashing risk in the context of posthoc explanations. I will also elaborate novel techniques for preventing fairwashing that aim at limiting the cheating possibilities of the adversary. To evaluate the practical efficiency of the methods developed, whenever possible they will be implemented in the form of prototypes, released in the form of an open-source library and experiments will be conducted with real datasets commonly used in the machine learning and fairness communities. The societal impact of the outcomes of my research program can be significant, as it has the potential to improve the privacy, fairness and explainability of models deployed in high-stake decision settings. In addition, the solutions developed will act as enablers by helping Canadian companies to implement models that are privacy-preserving and ethical by design. Finally, the research conducted will be done in cooperation with and contribute to the formation of HQP (i.e., PhD and master students).
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Quebec, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2022-05031
Name nom
Gambs, Sébastien
Department département
Computer science department
Organization id
57
Institution établissement
Université du Québec à Montréal
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2023
Competition year année de concours
2022
Award amount
35000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
800
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information and communication services
Area of application fr
Services d'information et de télécommunications
Research subject code
2805
Research subject group en
Artificial intelligence
Research subject group fr
Learning and inference theories
Research subject en
Intelligence artificielle
Research subject fr
Théories de l'apprentissage et l'inférence
Application title
Addressing jointly privacy and ethical issues in responsible machine learning
Keyword
Anonymization; Ethics of AI; Explainability; Fairness; Inference attacks; Machine learning; Privacy; Responsible AI
Application summary
The success of Machine Learning (ML) models is such that they are now ubiquitous in our society, which raises serious privacy and ethical issues (e.g., fairness and explainability), especially if their predictions are put into action in domains in which they can significantly affect individuals. There is a huge scientific literature that has studied in isolation, the concepts of privacy, fairness and interpretability in ML. However, very few works have explored the tensions, but also convergences, that emerge when addressing jointly these issues when designing and deploying ML models. The scope of my research program aims at answering this question by investigating when the achievement of these different objectives results in a positive sum game as well as the situations in which they conflict with each other, and a trade-off needs to be set. First, with respect to the intersection between privacy and fairness, the main challenge is to design fair models without collecting unnecessary sensitive attributes and while preventing privacy attacks on the training data or on the model. For example, I envision to adapt techniques coming from privacy such as anonymization mechanisms as well as data synthetization methods to also integrate fairness. Second, in the interactions between privacy and explainability, one of the main points of tension is that providing explanations necessarily reveal more information than simply outputting the prediction of the model. In this research direction, I propose to investigate which types of post hoc explanations among the existing ones offer the best robustness against privacy attacks. In addition of developing countermeasures to limit the success of such attacks, I will explore which families of interpretable models (e.g., linear models, decision trees or rule lists) offer the best protection against inference attacks. Third, at the crossings of fairness and explainability, I will work on the design of quantitative methods for evaluating the fairwashing risk in the context of posthoc explanations. I will also elaborate novel techniques for preventing fairwashing that aim at limiting the cheating possibilities of the adversary. To evaluate the practical efficiency of the methods developed, whenever possible they will be implemented in the form of prototypes, released in the form of an open-source library and experiments will be conducted with real datasets commonly used in the machine learning and fairness communities. The societal impact of the outcomes of my research program can be significant, as it has the potential to improve the privacy, fairness and explainability of models deployed in high-stake decision settings. In addition, the solutions developed will act as enablers by helping Canadian companies to implement models that are privacy-preserving and ethical by design. Finally, the research conducted will be done in cooperation with and contribute to the formation of HQP (i.e., PhD and master students).