Grant: Applied Research and Development Grants - Level 1
Sheridan Institute of Technology and Advanced Learning
$25,000.00
Custom Gesture Recognition Solution
FY 2018-19
Summary
Xesto Inc. is a Canadian tech developer of a web-based gesture recognition platform that will allow developers to enhance users' ability to control and interact with devices using hand gestures that do not require touching a screen or other controls. Applications for this platform include mobile and cloud-based services for entertainment, automotive, health/wellness, productivity, and business/product discovery. Xesto currently works with automotive companies on touchless dashboards and has had interest from various other industries (augmented & virtual reality producers, healthcare/wellness organizations, retail/online vendors, etc.). * Xesto seeks to collaborate with Sheridan's Screen Industries Research and Training Centre (SIRT) to further develop their innovative gesture recognition product into a version compatible with phones and other mobile devices. The enhanced system aims to provide custom gesture recognition for the iPhone's Augmented Reality (AR) Kit, with modularity that allows portability to Google's AR Core and hardware/software integration on other devices. * Currently, most companies that focus on gesture detection on mobile phones don't utilize a depth camera, relying solely on a less accurate and efficient RGB camera to detect and track hands. Xesto and SIRT propose to conduct research to identify and optimize hand tracking, hand segmentation and gesture recognition algorithms, which will allow a system to run on any type of device or platform using a depth camera. The anticipated research outcomes will enable Xesto to broaden its expertise and services to assist developers and clients from multiple sectors, and provide the 'go-to tool' for gesture recognition in AR/VR experiences and applications. This will further Xesto's development of creating and marketing an innovative, industry leading device-agnostic gesture-detection system that will leverage the shift from 2D to 3D gesture detection and recognition. There are currently no major gesture companies in the market, and in a few years gesture-based technology will be commonplace. *
Program
Applied Research and Development Grants - Level 1
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
530410-2018
Name nom
England, Andrea
Department département
Head Office
Organization id
22156
Institution établissement
Sheridan Institute of Technology and Advanced Learning
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2018
Competition year année de concours
2018
Award amount
25000
Program id
CARD1
Program name en
Applied Research and Development Grants - Level 1
Program name fr
Subventions de recherche et développement appliquée - niveau 1
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
1561
Committee name en
Applied Research and Development Grants
Committee name fr
Subventions de recherche et développement appliquée
Area of application code
801
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Computer software
Area of application fr
Logiciel
Research subject code
2708
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Image processing
Research subject fr
Traitement des images
Partie
1
Nb partie
1
Application title
Custom Gesture Recognition Solution
Keyword
NSERC
Application summary
Xesto Inc. is a Canadian tech developer of a web-based gesture recognition platform that will allow developers to enhance users' ability to control and interact with devices using hand gestures that do not require touching a screen or other controls. Applications for this platform include mobile and cloud-based services for entertainment, automotive, health/wellness, productivity, and business/product discovery. Xesto currently works with automotive companies on touchless dashboards and has had interest from various other industries (augmented & virtual reality producers, healthcare/wellness organizations, retail/online vendors, etc.). * Xesto seeks to collaborate with Sheridan's Screen Industries Research and Training Centre (SIRT) to further develop their innovative gesture recognition product into a version compatible with phones and other mobile devices. The enhanced system aims to provide custom gesture recognition for the iPhone's Augmented Reality (AR) Kit, with modularity that allows portability to Google's AR Core and hardware/software integration on other devices. * Currently, most companies that focus on gesture detection on mobile phones don't utilize a depth camera, relying solely on a less accurate and efficient RGB camera to detect and track hands. Xesto and SIRT propose to conduct research to identify and optimize hand tracking, hand segmentation and gesture recognition algorithms, which will allow a system to run on any type of device or platform using a depth camera. The anticipated research outcomes will enable Xesto to broaden its expertise and services to assist developers and clients from multiple sectors, and provide the 'go-to tool' for gesture recognition in AR/VR experiences and applications. This will further Xesto's development of creating and marketing an innovative, industry leading device-agnostic gesture-detection system that will leverage the shift from 2D to 3D gesture detection and recognition. There are currently no major gesture companies in the market, and in a few years gesture-based technology will be commonplace. *
