Grant: Discovery Grants Program - Individual
University of Waterloo
$24,000.00
Utilizing interaction to improve information retrieval
EF 2010-11
Résumé
Information retrieval (IR) has become an important part of life with people regularly using IR systems to search the web, their email, and other collections of documents. Even with the success of commercial web search companies, people still fail to find the information that they need to answer their questions. We propose to better utilize the power of user interaction to improve the quality of IR systems. It is well-known that user interaction has the potential to significantly improve retrieval quality, but many user interaction mechanisms fail to be adopted by either commercial search providers or by the users of search systems. To create interaction mechanisms that are both powerful and adopted, we propose to create a collection of simple mechanisms that can be easily added to existing search systems. These simple interaction mechanisms, when taken as a whole, should speed the rate at which users can find answers to their questions. The proposed research program will build on our past work where we have shown that a widely adopted, simple interaction mechanism, ""find-similar"", has the potential to boost retrieval quality by over 20% compared to a state-of-the-art non-interactive retrieval system. We first plan to validate via user studies our earlier simulation based results for the find-similar interaction mechanism. Next we intend to develop new interaction mechanisms that will speed the rate that users can answer complex questions with an IR system. Finally, we will create new interactive IR evaluation techniques by further merging automated usability testing methods (e.g. user simulations) with traditional IR evaluation methods. The research program will follow a cycle of formative design of interaction mechanisms followed by summative user testing. Each part of the cycle will feedback into the other. Applying this process to the problem of complex question answering, we expect to achieve a 50% or greater improvement over non-interactive retrieval.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
371768-2009
Name nom
Smucker, Mark
Department département
Management Sciences
Organization id
33
Institution établissement
University of Waterloo
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2010
Competition year année de concours
2009
Award amount
24000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
330
Committee name en
Computing and Information Sciences - A
Committee name fr
Informatique - A
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2710
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Information systems design
Research subject fr
Conception de systèmes d'information
Partie
2
Nb partie
5
Application title
Utilizing interaction to improve information retrieval
Keyword
NSERC
Application summary
Information retrieval (IR) has become an important part of life with people regularly using IR systems to search the web, their email, and other collections of documents. Even with the success of commercial web search companies, people still fail to find the information that they need to answer their questions. We propose to better utilize the power of user interaction to improve the quality of IR systems. It is well-known that user interaction has the potential to significantly improve retrieval quality, but many user interaction mechanisms fail to be adopted by either commercial search providers or by the users of search systems. To create interaction mechanisms that are both powerful and adopted, we propose to create a collection of simple mechanisms that can be easily added to existing search systems. These simple interaction mechanisms, when taken as a whole, should speed the rate at which users can find answers to their questions. The proposed research program will build on our past work where we have shown that a widely adopted, simple interaction mechanism, ""find-similar"", has the potential to boost retrieval quality by over 20% compared to a state-of-the-art non-interactive retrieval system. We first plan to validate via user studies our earlier simulation based results for the find-similar interaction mechanism. Next we intend to develop new interaction mechanisms that will speed the rate that users can answer complex questions with an IR system. Finally, we will create new interactive IR evaluation techniques by further merging automated usability testing methods (e.g. user simulations) with traditional IR evaluation methods. The research program will follow a cycle of formative design of interaction mechanisms followed by summative user testing. Each part of the cycle will feedback into the other. Applying this process to the problem of complex question answering, we expect to achieve a 50% or greater improvement over non-interactive retrieval.