Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Discovery Grants Program - Individual

York University

$24,000.00

Interactive autonomous machines

FY 2024-25

Summary
Although there have been significant strides in our ability to design and deploy autonomous systems, key problems remain unsolved that are critical to future advances in this field. My research program concentrates on three of these key problems: multi-cue integration, plan development and reasoning, and human-robot interaction. Multi-cue integration: An autonomous machine must be able to capture sensory data from a range of different technologies to build a model of where it is and how it can move within its environment. The underlying approach here is to understand how humans build similar representations and to leverage this knowledge to solve the problem for machines. Over the last ten years or so I have been working with a group of international collaborators to understand how humans develop a sense of self-orientation and self-motion. Key here is performing controlled experiments in environments within which humans are presented with unusual cue combinations to illuminate the underlying cue integration process. With the completion of recent work in long duration bed rest, I have helped develop a deep and wide dataset of human self-orientation perception which I plan to use to construct a time-dependent cue integration model that will be evaluated using underwater robots. Plan development and execution: The machine must be able to reason about its environment and how it can act upon that environment. Traditionally, long term robot plans were developed using mechanisms that decomposed tasks based on logical structures. Although effective in its day, these planning approaches have been eclipsed by modern AI approaches (e.g, Deep Reinforcement Learning - DRL) that have demonstrated extraordinary capabilities, especially for tasks with reasonably short-term horizons for which appropriate training can be performed. How can we best integrate the lessons learned from classic planning regimes with the capabilities of mechanisms like DRL? Utilizing a set of specific tasks - invasive water plant monitoring and indoor environment monitoring - I plan to explore how best to use DRL to learn short-term plans that can be sequenced to provide task solutions for these complex, but highly structured tasks. Human-robot interaction (HRI): The machine must be able to interact with the environment and most critically it must be able to interact with humans that occupy the environment within which it is operating. My preliminary work suggests task-specific gesture language can be effective for HRI, but can we better leverage the underlying task structure to build effective HRI systems? Utilizing common commercial diver tasks, I plan to generalize my preliminary work here to condition language token and conversational structure priors within the HRI representation, and to leverage both in understanding human to robot communication.
Program
Discovery Grants Program - Individual
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
RGPIN-2022-04556
Name nom
Jenkin, Michael
Department département
EECS
Organization id
38
Institution établissement
York University
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2024
Competition year année de concours
2022
Award amount
24000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
1200
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Advancement of knowledge
Area of application fr
Avancement des connaissances
Research subject code
2804
Research subject group en
Artificial intelligence
Research subject group fr
Intelligence artificielle
Research subject en
Expert systems
Research subject fr
Systèmes experts
Field of research list names en
Not available
Field of research list names fr
Non disponible
Socioeconomic objective list names en
Not available
Socioeconomic objective list names fr
Non disponible
Application title
Interactive autonomous machines
Keywords
autonomous robots; multi-cue integration; interaction strategies for autonomous robots
Application summary
Although there have been significant strides in our ability to design and deploy autonomous systems, key problems remain unsolved that are critical to future advances in this field. My research program concentrates on three of these key problems: multi-cue integration, plan development and reasoning, and human-robot interaction. Multi-cue integration: An autonomous machine must be able to capture sensory data from a range of different technologies to build a model of where it is and how it can move within its environment. The underlying approach here is to understand how humans build similar representations and to leverage this knowledge to solve the problem for machines. Over the last ten years or so I have been working with a group of international collaborators to understand how humans develop a sense of self-orientation and self-motion. Key here is performing controlled experiments in environments within which humans are presented with unusual cue combinations to illuminate the underlying cue integration process. With the completion of recent work in long duration bed rest, I have helped develop a deep and wide dataset of human self-orientation perception which I plan to use to construct a time-dependent cue integration model that will be evaluated using underwater robots. Plan development and execution: The machine must be able to reason about its environment and how it can act upon that environment. Traditionally, long term robot plans were developed using mechanisms that decomposed tasks based on logical structures. Although effective in its day, these planning approaches have been eclipsed by modern AI approaches (e.g, Deep Reinforcement Learning - DRL) that have demonstrated extraordinary capabilities, especially for tasks with reasonably short-term horizons for which appropriate training can be performed. How can we best integrate the lessons learned from classic planning regimes with the capabilities of mechanisms like DRL? Utilizing a set of specific tasks - invasive water plant monitoring and indoor environment monitoring - I plan to explore how best to use DRL to learn short-term plans that can be sequenced to provide task solutions for these complex, but highly structured tasks. Human-robot interaction (HRI): The machine must be able to interact with the environment and most critically it must be able to interact with humans that occupy the environment within which it is operating. My preliminary work suggests task-specific gesture language can be effective for HRI, but can we better leverage the underlying task structure to build effective HRI systems? Utilizing common commercial diver tasks, I plan to generalize my preliminary work here to condition language token and conversational structure priors within the HRI representation, and to leverage both in understanding human to robot communication.
York University - $24,000 Grant (2024-25) | Canada Spends