Grant: Discovery Grants Program - Individual
University of Waterloo
$23,000.00
Decision Making in the Face of Uncertainty: Comparative Probability Metrics and Network Surveillance
FY 2023-24
Summary
Society today is inundated with data and this data revolution is changing the way decisions are being made; in all natural science and engineering (NSE) fields making decisions in the face of uncertainty and using data to inform these decisions is becoming commonplace. Here I propose a research program whose main objective is to develop tools and methodologies that facilitate such decision-making processes and that provide NSE researchers with clarity and confidence in two specific contexts. First, we consider comparisons in which the similarity or superiority of two or more characteristics is to be evaluated. Traditionally, such comparisons are made via hypothesis tests for which the null hypotheses assume equality. However, in practice it is often more natural to assume the characteristics are different until there is sufficient evidence to justify considering them equal. Importantly, in such contexts exact equivalence is not always necessary and instead practical equivalence is sufficient. Both of these considerations are gracefully handled by what I call the probability of agreement and other tailored comparative probability metrics (CPMs). These metrics and this way of thinking constitute an innovative and elegant means of formally evaluating and quantifying similarity and superiority while accounting for practical importance. Here I propose several novel CPM-based strategies for use in a variety of application areas including the comparison measurement devices, lifetime distributions, and outcomes in different experimental conditions. I expect that this research program will lead to a paradigm shift in decision-making strategies and to the replacement of hypothesis testing as the standard approach for making such comparisons. Second, we consider the field of network surveillance which is concerned with identifying anomalous activity in social networks. As the prevalence of social networks has increased in recent years, so also has the importance of network surveillance. My work has been devoted to the development of real-time monitoring methodologies that seek to identify when and how interactions within a network significantly change. Such techniques have been successful in identifying spammers, terrorists and fraudulent activity in social networks. This research area is burgeoning with many open research problems and monitoring strategies to explore. In this proposal I highlight my plans to develop a unified methodology that quickly and accurately detects anomalies while accounting for community structure, individual propensities for interaction, the direction of interactions as well as contextual information that might be useful. Such a methodology will advance the current state-of-the-art and greatly improve our ability to identify nefarious activity in social networks. This research program will involve both graduate and undergraduate students who will all conduct timely and impactful research and acquire highly sought-after skills.
Program
Discovery Grants Program - Individual
Recipient
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
RGPIN-2019-04212
Name nom
Stevens, Nathaniel
Department département
Statistics & Actuarial Science
Organization id
33
Institution établissement
University of Waterloo
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2023
Competition year année de concours
2019
Award amount
23000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1508
Committee name en
Mathematics and Statistics
Committee name fr
Mathématiques et statistique
Area of application code
500
Area of application group en
Manufacturing processes and products
Area of application group fr
Procédés et produits industriels
Area of application en
Manufacturing processes and products
Area of application fr
Procédés et produits industriels
Research subject code
9999
Research subject group en
Not available
Research subject group fr
Not available
Research subject en
Non disponible
Research subject fr
Non disponible
Application title
Decision Making in the Face of Uncertainty: Comparative Probability Metrics and Network Surveillance
Keyword
design of experiments; measurement system evaluation; network surveillance; probability of agreement; quality improvement; reliability; statistical process control
Application summary
Society today is inundated with data and this data revolution is changing the way decisions are being made; in all natural science and engineering (NSE) fields making decisions in the face of uncertainty and using data to inform these decisions is becoming commonplace. Here I propose a research program whose main objective is to develop tools and methodologies that facilitate such decision-making processes and that provide NSE researchers with clarity and confidence in two specific contexts. First, we consider comparisons in which the similarity or superiority of two or more characteristics is to be evaluated. Traditionally, such comparisons are made via hypothesis tests for which the null hypotheses assume equality. However, in practice it is often more natural to assume the characteristics are different until there is sufficient evidence to justify considering them equal. Importantly, in such contexts exact equivalence is not always necessary and instead practical equivalence is sufficient. Both of these considerations are gracefully handled by what I call the probability of agreement and other tailored comparative probability metrics (CPMs). These metrics and this way of thinking constitute an innovative and elegant means of formally evaluating and quantifying similarity and superiority while accounting for practical importance. Here I propose several novel CPM-based strategies for use in a variety of application areas including the comparison measurement devices, lifetime distributions, and outcomes in different experimental conditions. I expect that this research program will lead to a paradigm shift in decision-making strategies and to the replacement of hypothesis testing as the standard approach for making such comparisons. Second, we consider the field of network surveillance which is concerned with identifying anomalous activity in social networks. As the prevalence of social networks has increased in recent years, so also has the importance of network surveillance. My work has been devoted to the development of real-time monitoring methodologies that seek to identify when and how interactions within a network significantly change. Such techniques have been successful in identifying spammers, terrorists and fraudulent activity in social networks. This research area is burgeoning with many open research problems and monitoring strategies to explore. In this proposal I highlight my plans to develop a unified methodology that quickly and accurately detects anomalies while accounting for community structure, individual propensities for interaction, the direction of interactions as well as contextual information that might be useful. Such a methodology will advance the current state-of-the-art and greatly improve our ability to identify nefarious activity in social networks. This research program will involve both graduate and undergraduate students who will all conduct timely and impactful research and acquire highly sought-after skills.