Canada Spends Logo

Explorez notre analyse du budget 2026

Grant: Discovery Grants Program - Individual

University of Waterloo

$20,000.00

Evaluation of High-Recall Human-in-the-Loop Information Retrieval Technologies

EF 2017-18

Résumé
The objective of high-recall information retrieval (HRIR) is to identify substantially all information relevant to an information need, where the consequences of missing or untimely results may have serious legal, policy, health, social, safety, defence, or financial implications. To find acceptance in practice, HRIR technologies must be more effectiveand must be shown to be more effectivethan current practice, according to the legal, statutory, regulatory, ethical, or professional standards governing the application domain. The applicant is the leading expert in this field, having first recognized the transferability of machine-learning technologies from spam filtering to electronic discovery, and then having established the scientific foundation for their acceptance in civil litigation and regulatory proceedings, both in the United States and Europe. The proposed research includes experiments seeking to enhance and extend the HRIR results achieved to date, within application domains where it is critical to satisfy an information need when it arises, and on an ongoing basis, by finding substantially all relevant information. In furtherance of these goals, four general avenues of investigation will be pursued: (1) measuring the effectiveness of HRIR technologies in practice using live data and real information needs; (2) modeling more nuanced user-system interactions and employing higher-fidelity evaluation measures; (3) addressing the technological and logistical challenges presented by massive datasets and high-volume data streams; and (4) discovering and evaluating the effectiveness of HRIR technologies in new applications domains. Such domains include, but are not limited to, distinguishing between public and non-public records in the curation of government archives; systematic review for meta-analysis in evidence-based medicine; separating irregularities and intentional misstatements from unintentional errors in accounting restatements; performing due diligence in connection with pending mergers, acquisitions, and financing transactions; and surveillance and compliance activities involving massive datasets. The proposed research promises to establish the effectiveness of HRIR technology over current practice in those domains, as well as others.
Programme
Discovery Grants Program - Individual
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data

Tel que publié

Application id
RGPIN-2017-04239
Name nom
Grossman, Maura
Department département
Computer Science, David R. Cheriton School of - Computer Science, David R. Cheri
Organization id
33
Institution établissement
University of Waterloo
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2017
Competition year année de concours
2017
Award amount
20000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
2717
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Modelling and simulation studies
Research subject fr
Études de modélisation et de simulation
Partie
1
Nb partie
5
Application title
Evaluation of High-Recall Human-in-the-Loop Information Retrieval Technologies
Keyword
NSERC
Application summary
The objective of high-recall information retrieval (HRIR) is to identify substantially all information relevant to an information need, where the consequences of missing or untimely results may have serious legal, policy, health, social, safety, defence, or financial implications. To find acceptance in practice, HRIR technologies must be more effectiveand must be shown to be more effectivethan current practice, according to the legal, statutory, regulatory, ethical, or professional standards governing the application domain. The applicant is the leading expert in this field, having first recognized the transferability of machine-learning technologies from spam filtering to electronic discovery, and then having established the scientific foundation for their acceptance in civil litigation and regulatory proceedings, both in the United States and Europe. The proposed research includes experiments seeking to enhance and extend the HRIR results achieved to date, within application domains where it is critical to satisfy an information need when it arises, and on an ongoing basis, by finding substantially all relevant information. In furtherance of these goals, four general avenues of investigation will be pursued: (1) measuring the effectiveness of HRIR technologies in practice using live data and real information needs; (2) modeling more nuanced user-system interactions and employing higher-fidelity evaluation measures; (3) addressing the technological and logistical challenges presented by massive datasets and high-volume data streams; and (4) discovering and evaluating the effectiveness of HRIR technologies in new applications domains. Such domains include, but are not limited to, distinguishing between public and non-public records in the curation of government archives; systematic review for meta-analysis in evidence-based medicine; separating irregularities and intentional misstatements from unintentional errors in accounting restatements; performing due diligence in connection with pending mergers, acquisitions, and financing transactions; and surveillance and compliance activities involving massive datasets. The proposed research promises to establish the effectiveness of HRIR technology over current practice in those domains, as well as others.