Grant: Discovery Grants Program - Individual
McGill University
$34,000.00
Developing robust methods for the measurement of online social media populations
EF 2018-19
Résumé
In June 2016, troubling evidence surfaced showing Google's search engine to be racist. At issue were the radically different images returned by the search terms three white teenagers and three black teenagers. The former search returned wholesome pictures of teenagers playing sports and hanging out. The latter returned mugshots. Google defended the search results, indicating that their search algorithms were informed by web content and the frequency with which it was accessed and linked. Google - the company that runs software used daily by millions of people to find information on the internet - asserted that any such bias in their search results were fundamentally a societal problem.*And there, in essence, is the conundrum. We look to Google search along with myriad other online services from Yelp to OkCupid to Facebook to reflect the world. And in doing so, we give it the power to reinforce the social structures in it. When machine learning algorithms become vehicles for propagating undesirable stereotypes and marginalizing minority views which we call algorithmic prejudice - we have a problem.*Addressing algorithmic prejudice presents two challenges. First, we must detect when a prejudice exists. Second, where a prejudice exists and is deemed necessary to correct, we require methods for adjusting the algorithm's performance. These are the central tasks we consider in this proposal.*We will tackle these problems in three phases. First, we will develop methods to aid in the detection of algorithmic prejudice. Second, in collaboration with domain experts, we will use our detection methods to do a detailed characterization of the prejudice present in algorithms for detecting hate speech and identifying political orientation. Using these findings, we will approach the final topic of this proposal, which is methods for correcting algorithmic prejudice either by modifying the algorithms themselves or by adjusting the data that the algorithms are trained on.*As increasing numbers of services migrate online, we must ensure that these systems reflect the aspirations of society, not its worst and most predatory elements. Our hope is that this work will provide viable solutions for companies to ensure prejudice-free systems and that our findings stimulate further work on this important topics.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Quebec, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2017-05165
Name nom
Ruths, Derek
Department département
Computer Science, School of
Organization id
61
Institution établissement
McGill University
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2018
Competition year année de concours
2017
Award amount
34000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2801
Research subject group en
Artificial intelligence
Research subject group fr
Intelligence artificielle
Research subject en
Natural language and speech understanding
Research subject fr
Langage naturel et reconnaissance de la parole
Partie
2
Nb partie
5
Application title
Developing robust methods for the measurement of online social media populations
Keyword
NSERC
Application summary
In June 2016, troubling evidence surfaced showing Google's search engine to be racist. At issue were the radically different images returned by the search terms three white teenagers and three black teenagers. The former search returned wholesome pictures of teenagers playing sports and hanging out. The latter returned mugshots. Google defended the search results, indicating that their search algorithms were informed by web content and the frequency with which it was accessed and linked. Google - the company that runs software used daily by millions of people to find information on the internet - asserted that any such bias in their search results were fundamentally a societal problem.*And there, in essence, is the conundrum. We look to Google search along with myriad other online services from Yelp to OkCupid to Facebook to reflect the world. And in doing so, we give it the power to reinforce the social structures in it. When machine learning algorithms become vehicles for propagating undesirable stereotypes and marginalizing minority views which we call algorithmic prejudice - we have a problem.*Addressing algorithmic prejudice presents two challenges. First, we must detect when a prejudice exists. Second, where a prejudice exists and is deemed necessary to correct, we require methods for adjusting the algorithm's performance. These are the central tasks we consider in this proposal.*We will tackle these problems in three phases. First, we will develop methods to aid in the detection of algorithmic prejudice. Second, in collaboration with domain experts, we will use our detection methods to do a detailed characterization of the prejudice present in algorithms for detecting hate speech and identifying political orientation. Using these findings, we will approach the final topic of this proposal, which is methods for correcting algorithmic prejudice either by modifying the algorithms themselves or by adjusting the data that the algorithms are trained on.*As increasing numbers of services migrate online, we must ensure that these systems reflect the aspirations of society, not its worst and most predatory elements. Our hope is that this work will provide viable solutions for companies to ensure prejudice-free systems and that our findings stimulate further work on this important topics.