Grant: Discovery Grants Program - Individual
University of Toronto
$41,000.00
Ontologies for the Physical Turing Test
FY 2021-22
Summary
The Turing Test was originally proposed as a way of evaluating how well a software system represents human intelligence, based on natural language conversations. It has recently been recognized that a different approach is needed that incorporates capabilities required for general intelligence. The Visual Turing Test extends the Turing Test to include perception -- it specifies an open domain task of question answering based on corpora of images depicting real-world scenes. The Physical Turing Test extends this further by specifying questions that require the integration of perception, reasoning, and action. To capture the commonsense knowledge required to perform the Physical Turing Test, existing approaches to computer vision and robotics have begun to include simple knowledge representation schemes such as WordNet. However, such approaches cannot fully specify the intended semantics of the terminology,nor can they support automated reasoning. What is needed is an ontology, that is, a computer interpretable specification that is used by an agent, application, or other information resource to declare what terms it uses, and what the terms mean. In this project, we will design new ontologies in first-order logic that can represent objects in the physical world, the activities in which these objects can possibly participate, and how to recognize these objects and the spatial relationships between them within images. (We will refer to these as the PRAxIS Ontologies, for Perception, Reasoning, and Action across Intelligent Systems) These ontologies will be integrated to support reasoning about physical objects, their behaviours (e.g. the ways in which they can change), and their interactions (e.g.manipulation of solid physical objects). Ontologies for perception will be tested using question-answering based on real-world images, such as detecting and localizing instances of objects and relationships among the objects in a scene. Ontologies for action will be tested through the representation of instructions for assembling, using, and maintaining physical objects, including devices and everyday objects such as furniture To support the question-answering for the Physical Turing Test, this project will also investigate reasoning (theorem proving and constraint satisfaction) with first-order ontologies.
Program
Discovery Grants Program - Individual
Recipient
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
RGPIN-2020-05781
Name nom
Gruninger, Michael
Department département
Mechanical and Industrial Engineering - Mechanical and Industrial Engineering
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2021
Competition year année de concours
2020
Award amount
41000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2803
Research subject group en
Artificial intelligence
Research subject group fr
Intelligence artificielle
Research subject en
Knowledge representation
Research subject fr
Répresentation des connaissances
Installment
inst:2
Partie
1
Nb partie
5
Application title
Ontologies for the Physical Turing Test
Keyword
NSERC
Application summary
The Turing Test was originally proposed as a way of evaluating how well a software system represents human intelligence, based on natural language conversations. It has recently been recognized that a different approach is needed that incorporates capabilities required for general intelligence. The Visual Turing Test extends the Turing Test to include perception -- it specifies an open domain task of question answering based on corpora of images depicting real-world scenes. The Physical Turing Test extends this further by specifying questions that require the integration of perception, reasoning, and action. To capture the commonsense knowledge required to perform the Physical Turing Test, existing approaches to computer vision and robotics have begun to include simple knowledge representation schemes such as WordNet. However, such approaches cannot fully specify the intended semantics of the terminology,nor can they support automated reasoning. What is needed is an ontology, that is, a computer interpretable specification that is used by an agent, application, or other information resource to declare what terms it uses, and what the terms mean. In this project, we will design new ontologies in first-order logic that can represent objects in the physical world, the activities in which these objects can possibly participate, and how to recognize these objects and the spatial relationships between them within images. (We will refer to these as the PRAxIS Ontologies, for Perception, Reasoning, and Action across Intelligent Systems) These ontologies will be integrated to support reasoning about physical objects, their behaviours (e.g. the ways in which they can change), and their interactions (e.g.manipulation of solid physical objects). Ontologies for perception will be tested using question-answering based on real-world images, such as detecting and localizing instances of objects and relationships among the objects in a scene. Ontologies for action will be tested through the representation of instructions for assembling, using, and maintaining physical objects, including devices and everyday objects such as furniture To support the question-answering for the Physical Turing Test, this project will also investigate reasoning (theorem proving and constraint satisfaction) with first-order ontologies.