Grant: Discovery Grants Program - Individual
University of Waterloo
$24,000.00
Evaluation and improvement of search tools for critical information
EF 2013-14
Résumé
We investigate the effectiveness of using search technologies to identify, as nearly as possible, all relevant documents within a very large electronic dataset, while at the same time identifying no irrelevant documents. Applications include spam filtering, legal search, medical informatics, law enforcement, security and intelligence. For these applications it is necessary not only to identify many relevant documents and few irrelevant ones, but to estimate how many of each are identified, and how many are missed.The crux of the problem is to measure precisely and accurately the effectiveness of approaches for their intended purpose. We propose to design and deploy an evaluation appliance suitable for measuring the efficacy of search tools, without intervention from the user. An evaluation appliance allows different technologies and methods to be compared in parallel experiments, including some that are embedded in sensitive processes to which evaluation experts have no direct access.The anticipated outcomes of this research are: precise measurements of the effectiveness of current technologies for exhaustive search; improvement in the state of the art in technologies for exhaustive search, demonstrated by precise measurement; tools to provide prior estimates and ongoing estimates of the effectiveness of particular search strategies for specific tasks.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
5485-2011
Name nom
Cormack, Gordon
Department département
Computer Science, David R. Cheriton School of
Organization id
33
Institution établissement
University of Waterloo
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2013
Competition year année de concours
2011
Award amount
24000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
2700
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Information technology
Research subject fr
Technologie de l'information
Partie
3
Nb partie
5
Application title
Evaluation and improvement of search tools for critical information
Keyword
NSERC
Application summary
We investigate the effectiveness of using search technologies to identify, as nearly as possible, all relevant documents within a very large electronic dataset, while at the same time identifying no irrelevant documents. Applications include spam filtering, legal search, medical informatics, law enforcement, security and intelligence. For these applications it is necessary not only to identify many relevant documents and few irrelevant ones, but to estimate how many of each are identified, and how many are missed.The crux of the problem is to measure precisely and accurately the effectiveness of approaches for their intended purpose. We propose to design and deploy an evaluation appliance suitable for measuring the efficacy of search tools, without intervention from the user. An evaluation appliance allows different technologies and methods to be compared in parallel experiments, including some that are embedded in sensitive processes to which evaluation experts have no direct access.The anticipated outcomes of this research are: precise measurements of the effectiveness of current technologies for exhaustive search; improvement in the state of the art in technologies for exhaustive search, demonstrated by precise measurement; tools to provide prior estimates and ongoing estimates of the effectiveness of particular search strategies for specific tasks.