Canada Spends Logo

Explorez notre analyse du budget 2026

Grant: Discovery Grants Program - Individual

University of Victoria

$81,000.00

Predicting and Preventing Toxicity within Immersive Social Technologies

EF 2024-25

Résumé
Innovations in novel immersive social technologies (IST)-such as multiplayer games, social virtual reality (VR), and the metaverse-provide massive benefits; however, these same technologies can also bring harm. Multiplayer games can combat loneliness and provide social value, but also breed toxicity, extremism, and problematic gaming. Social VR supports immersive and embodied interaction, but has also introduced novel platforms for harassment and abuse. Metaverse technologies help children develop creativity and skills, but also expose them to cyberbullying. Toxicity refers to abusive communications and disruptive behaviors that violate the rules and social norms of the community. Current approaches to combating toxicity in ISTs rely on detecting when it occurs using reporting mechanisms or artificial intelligence (AI) approaches (e.g., detect abusive chat), and mitigating it through moderation (e.g., removing offensive chat) and sanctions (e.g., banning offending user). However, these approaches are blunt, costly, and occur after the fact; most importantly, they are unsuccessful-exposure to toxicity in ISTs has increased, in spite of efforts by both academia and industry. The problem is that current approaches rely on detecting the occurrence of harm, rather than predicting that harm is likely to occur through signals that reveal developing toxicity, which would allow for mitigation strategies that prevent toxicity before harm occurs. Several computer science (CS) methods are needed to predict and mitigate harm in ISTs due to toxicity: advanced skills in recognition algorithms, data mining, signal processing, computational modeling, machine learning and interaction design are needed in conjunction with an understanding of human behaviour, suggesting that progress requires researchers to employ CS approaches from a human-computer interaction (HCI) perspective. My long-term research objective is to design, develop, and evaluate innovative technologies that predict and prevent toxic interactions in immersive social technologies. This goal will be achieved through three research objectives, in which I work with my HQP to: 1) Predict raging (aggressive outbursts) before it occurs, 2) Detect disruptive behaviours as they develop, and 3) Design interfaces that prevent toxicity. This research will benefit Canada by training 23 HQP with specialized skills who are in great demand in the Canadian game and software development industries, will benefit Canadian tech companies by helping improve their products and extend to new markets, will help Canadians by developing immersive social technologies that prioritize safety from harm, and will yield groundbreaking scientific advances in methods for predicting and preventing harm that can be harnessed by researchers, designers, scientists, and policy makers to understand, model, and improve the impact of innovations in immersive social technologies.
Programme
Discovery Grants Program - Individual
Emplacement
British Columbia, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data

Tel que publié

Application id
RGPIN-2024-05175
Name nom
Mandryk, Regan
Department département
Computer Science - Computer Science
Organization id
7
Institution établissement
University of Victoria
Province en
British Columbia
Province fr
Colombie-Britannique
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2024
Competition year année de concours
2024
Award amount
81000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2700
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Information technology
Research subject fr
Technologie de l'information
Field of research list names en
Not available
Field of research list names fr
Non disponible
Socioeconomic objective list names en
Not available
Socioeconomic objective list names fr
Non disponible
Application title
Predicting and Preventing Toxicity within Immersive Social Technologies
Keywords
toxicity; social technologies; digital games; social virtual reality; affective computing; physiological computing; online multiplayer games; data mining; digital biomarkers; digital signal processing
Application summary
Innovations in novel immersive social technologies (IST)-such as multiplayer games, social virtual reality (VR), and the metaverse-provide massive benefits; however, these same technologies can also bring harm. Multiplayer games can combat loneliness and provide social value, but also breed toxicity, extremism, and problematic gaming. Social VR supports immersive and embodied interaction, but has also introduced novel platforms for harassment and abuse. Metaverse technologies help children develop creativity and skills, but also expose them to cyberbullying. Toxicity refers to abusive communications and disruptive behaviors that violate the rules and social norms of the community. Current approaches to combating toxicity in ISTs rely on detecting when it occurs using reporting mechanisms or artificial intelligence (AI) approaches (e.g., detect abusive chat), and mitigating it through moderation (e.g., removing offensive chat) and sanctions (e.g., banning offending user). However, these approaches are blunt, costly, and occur after the fact; most importantly, they are unsuccessful-exposure to toxicity in ISTs has increased, in spite of efforts by both academia and industry. The problem is that current approaches rely on detecting the occurrence of harm, rather than predicting that harm is likely to occur through signals that reveal developing toxicity, which would allow for mitigation strategies that prevent toxicity before harm occurs. Several computer science (CS) methods are needed to predict and mitigate harm in ISTs due to toxicity: advanced skills in recognition algorithms, data mining, signal processing, computational modeling, machine learning and interaction design are needed in conjunction with an understanding of human behaviour, suggesting that progress requires researchers to employ CS approaches from a human-computer interaction (HCI) perspective. My long-term research objective is to design, develop, and evaluate innovative technologies that predict and prevent toxic interactions in immersive social technologies. This goal will be achieved through three research objectives, in which I work with my HQP to: 1) Predict raging (aggressive outbursts) before it occurs, 2) Detect disruptive behaviours as they develop, and 3) Design interfaces that prevent toxicity. This research will benefit Canada by training 23 HQP with specialized skills who are in great demand in the Canadian game and software development industries, will benefit Canadian tech companies by helping improve their products and extend to new markets, will help Canadians by developing immersive social technologies that prioritize safety from harm, and will yield groundbreaking scientific advances in methods for predicting and preventing harm that can be harnessed by researchers, designers, scientists, and policy makers to understand, model, and improve the impact of innovations in immersive social technologies.