Grant: Discovery Grants Program - Individual
University of Toronto
$56,000.00
Mixed reality in pediatric rehabilitation
FY 2022-23
Summary
Mixed reality (MR) video games, wherein real-life objects are used to interact with virtual environments, can provide children with disabilities with engaging, home-based opportunities to practice fine motor skills needed for everyday function. The ability to accurately track objects is key to the design and widespread use of MR video games. Cameras are often used to track objects in MR as they are low-cost, compact and widely available. However, camera-based approaches to object tracking have limitations objects often need to be tagged with special markers/identifiers, tracking performance is sensitive to the environment (e.g. lighting) and prone to errors for fast-moving or occluded objects. This research program will address current challenges in object tracking for MR applications by combining information from many different sources and sensors. For instance, tracking movements of the player can be indicative of interactions with, and movements of, the targeted object. Additionally, the tasks presented by the MR game can be predictive of when/where to expect changes in object position. Likewise, relying on diverse sensors (e.g. colour, depth, inertial) can provide greater informational content regarding an object's movements and the ability to better adapt to changes in operating conditions. Novel contributions of this research will include methods to: (1) determine when to rely on different information sources/sensors, (2) adapt the system dynamically to changes in operating conditions (e.g. proximity to sensor, occlusions) that may impact the reliability of different information sources, (3) detect movements/gestures associated with object interactions for children with a range of abilities, and (4) generalize the approaches developed for diverse MR applications. In the course of this research, three novel MR therapy games will be designed with high potential for commercialization and translation. Eight graduate and four undergraduate students will be provided with high quality, interdisciplinary training in computer vision, digital media, and user-centred design with opportunities to interact with industry leaders in digital media and with healthcare providers in clinical contexts. Trainees will be well-positioned to pursue careers in academia, industry, and entrepreneurship in the fields of digital media and health technology, two of Canada's most high demand sectors.
Program
Discovery Grants Program - Individual
Recipient
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
RGPIN-2017-06534
Name nom
Biddiss, Elaine
Department département
Biomaterials and Biomedical Engineering, Inst. of (IBBME) - Biomaterials and Biomedical Engineering, Inst. of (IBBME)
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2022
Competition year année de concours
2017
Award amount
56000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1509
Committee name en
Civil, Industrial and Systems Engineering
Committee name fr
Génie civil, industriel et des systèmes
Area of application code
1101
Area of application group en
Health, education and social services
Area of application group fr
Santé publique, éducation et services sociaux
Area of application en
Human health (including medically-related psychological research)
Area of application fr
Santé publique (y compris recherche psychologique liée à la médecine)
Research subject code
7000
Research subject group en
Other studies in natural sciences and engineering
Research subject group fr
Autres études en sciences naturelles et en génie
Research subject en
Other studies in natural sciences and engineering
Research subject fr
Autres études en sciences naturelles et en génie
Installment
inst:5;6
Partie
2
Nb partie
6
Application title
Mixed reality in pediatric rehabilitation
Application summary
Mixed reality (MR) video games, wherein real-life objects are used to interact with virtual environments, can provide children with disabilities with engaging, home-based opportunities to practice fine motor skills needed for everyday function. The ability to accurately track objects is key to the design and widespread use of MR video games. Cameras are often used to track objects in MR as they are low-cost, compact and widely available. However, camera-based approaches to object tracking have limitations objects often need to be tagged with special markers/identifiers, tracking performance is sensitive to the environment (e.g. lighting) and prone to errors for fast-moving or occluded objects. This research program will address current challenges in object tracking for MR applications by combining information from many different sources and sensors. For instance, tracking movements of the player can be indicative of interactions with, and movements of, the targeted object. Additionally, the tasks presented by the MR game can be predictive of when/where to expect changes in object position. Likewise, relying on diverse sensors (e.g. colour, depth, inertial) can provide greater informational content regarding an object's movements and the ability to better adapt to changes in operating conditions. Novel contributions of this research will include methods to: (1) determine when to rely on different information sources/sensors, (2) adapt the system dynamically to changes in operating conditions (e.g. proximity to sensor, occlusions) that may impact the reliability of different information sources, (3) detect movements/gestures associated with object interactions for children with a range of abilities, and (4) generalize the approaches developed for diverse MR applications. In the course of this research, three novel MR therapy games will be designed with high potential for commercialization and translation. Eight graduate and four undergraduate students will be provided with high quality, interdisciplinary training in computer vision, digital media, and user-centred design with opportunities to interact with industry leaders in digital media and with healthcare providers in clinical contexts. Trainees will be well-positioned to pursue careers in academia, industry, and entrepreneurship in the fields of digital media and health technology, two of Canada's most high demand sectors.