Grant: Discovery Grants Program - Individual
McGill University
$29,000.00
Enabling Common Sense Reasoning in Natural Language Processing Systems
EF 2024-25
Résumé
Artificial intelligence systems that understand and generate natural language have made great strides in recent years, leading to successful commercial deployments. Nevertheless, there is ample evidence that current natural language processing (NLP) systems fail in systematic and un-human-like ways, despite high levels of average performance. Much of this failure is due to the lack of knowledge about typical causes and effects in the world, as well as a limited ability to reason about them; in other words, they lack common sense knowledge about the world.
My research program aims to develop NLP systems that are capable of such common sense reasoning skills, such that they can communicate and collaborate with human users without requiring explicit training for every new task or topic. The key idea of the proposed research is to build an explicit formal structure that connects the textual elements to each other, on the one hand, and also to relevant background information that the system has already built up knowledge about, on the other. On the technical side, we will propose new neural network architectures and models, which are promising because they provide easy and natural methods to transfer knowledge between multiple sources and tasks via network parameter sharing in multi-task learning and transfer learning setups.
The objectives of the project will be organized by the type of common sense and world knowledge structure that is required for a particular inference task. The first one is to make use of the extensive structured knowledge base and resource about common entities and event sequences, such as Wikipedia, and ConceptNet. Here, the target NLP applications we aim to improve are entity and event coreference resolution, which involve determining which textual elements point to the same real-world entities and events, respectively.
A second objective domain is in reasoning about emotions, social interactions, and the inner mental states of others, which is known in cognitive science as possessing a theory of mind. Being able to reason about the likely reactions of others is a crucial step in generating contextually appropriate responses in conversational agents, and in ensuring coherence in longer generated passages.
A third, challenging domain is that of fictional scenarios and situations, in which the typical expectation of the world which might be learned by reading large amounts of web text might be subverted in interesting and predictable ways. A system that is truly capable of common sense reasoning should be able to imagine the potential consequences even in such unlikely scenarios; e.g., that humans living on Mars would need a spacesuit to breathe or to terraform it so that there is oxygen in the atmosphere.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Quebec, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2020-04871
Name nom
Cheung, Jackie
Department département
Computer Science, School of - Computer Science, School of
Organization id
61
Institution établissement
McGill University
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2024
Competition year année de concours
2020
Award amount
29000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2800
Research subject group en
Artificial intelligence
Research subject group fr
Intelligence artificielle
Research subject en
Artificial intelligence (computer vision, use2603)
Research subject fr
Intelligence artificielle (vision artificielle, utiliser 2603)
Field of research list names en
Not available
Field of research list names fr
Non disponible
Socioeconomic objective list names en
Not available
Socioeconomic objective list names fr
Non disponible
Application title
Enabling Common Sense Reasoning in Natural Language Processing Systems
Keywords
natural language processing; computational linguistics; artificial intelligence; computational pragmatics; computational semantics; common sense reasoning
Application summary
Artificial intelligence systems that understand and generate natural language have made great strides in recent years, leading to successful commercial deployments. Nevertheless, there is ample evidence that current natural language processing (NLP) systems fail in systematic and un-human-like ways, despite high levels of average performance. Much of this failure is due to the lack of knowledge about typical causes and effects in the world, as well as a limited ability to reason about them; in other words, they lack common sense knowledge about the world.
My research program aims to develop NLP systems that are capable of such common sense reasoning skills, such that they can communicate and collaborate with human users without requiring explicit training for every new task or topic. The key idea of the proposed research is to build an explicit formal structure that connects the textual elements to each other, on the one hand, and also to relevant background information that the system has already built up knowledge about, on the other. On the technical side, we will propose new neural network architectures and models, which are promising because they provide easy and natural methods to transfer knowledge between multiple sources and tasks via network parameter sharing in multi-task learning and transfer learning setups.
The objectives of the project will be organized by the type of common sense and world knowledge structure that is required for a particular inference task. The first one is to make use of the extensive structured knowledge base and resource about common entities and event sequences, such as Wikipedia, and ConceptNet. Here, the target NLP applications we aim to improve are entity and event coreference resolution, which involve determining which textual elements point to the same real-world entities and events, respectively.
A second objective domain is in reasoning about emotions, social interactions, and the inner mental states of others, which is known in cognitive science as possessing a theory of mind. Being able to reason about the likely reactions of others is a crucial step in generating contextually appropriate responses in conversational agents, and in ensuring coherence in longer generated passages.
A third, challenging domain is that of fictional scenarios and situations, in which the typical expectation of the world which might be learned by reading large amounts of web text might be subverted in interesting and predictable ways. A system that is truly capable of common sense reasoning should be able to imagine the potential consequences even in such unlikely scenarios; e.g., that humans living on Mars would need a spacesuit to breathe or to terraform it so that there is oxygen in the atmosphere.