Grant: Alliance Grants
Ryerson University
$29,800.00
Research and development of a cloud-based context-aware API for semantic scene understanding _x000d_ _x000d_ _x000d_
EF 2020-21
Résumé
Augmented Reality (AR) has become a promising tool for enhancing the quality of experience in digital media products. However, the technical tools available for AR lacks in providing the rich understanding required to design interactive digital experiences quickly and efficiently. In partnership with AWE Company Ltd, this research project will attempt at developing a context-aware Application Programming Interface (API) that can provide a semantic understanding of a user's surrounding by intelligently distributing the camera feed data from a user's device on to three separate sub-modules for semantic understanding: building facade segmentation, floor plan creation, and object localization. Through understanding the user's context (i.e. the requirement of the understanding of the aforementioned semantics), the proposed API can reduce the computational and data overhead required to run the neural network-based systems on the cloud. The proposed project will employ Distributed Deep Neural Network (DDNN) design principles to carefully distribute the computational task between the clients and the cloud, while building the semantic understanding stack on top of available technology tools such as ARCore/ARKit, so that AWE's software developers can easily integrate the proposed solution into their product development pipeline.
The proposed API will result in a robust framework for quick distribution of digital twins projects that AWE plans to roll out for many of its clients within the next two years. The proposed research will help to position Canada as a leader in multimedia technologies, while the resultant technology transfer to Canadian industry will strengthen Canada's global competitiveness and create positive impacts to Canadian economy and society.
Programme
Alliance Grants
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
558247-2020
Name nom
Khan, Naimul
Department département
Electrical, Computer and Biomedical Engineering
Organization id
43
Institution établissement
Ryerson University
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2020
Competition year année de concours
2020
Award amount
29800
Program id
ALLRP
Program name en
Alliance Grants
Program name fr
Subventions Alliance
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
96
Committee name en
RPP Internal Decision Cttee
Committee name fr
Cté de décision interne - PPR
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2514
Research subject group en
Electrical and electronic engineering
Research subject group fr
Génie électrique et électronique
Research subject en
Digital signal processing
Research subject fr
Traitement des signaux numériques
Installment
inst:1 - 1
Partie
1
Nb partie
1
Application title
Research and development of a cloud-based context-aware API for semantic scene understanding _x000d_
_x000d_
_x000d_
Keyword
NSERC
Application summary
Augmented Reality (AR) has become a promising tool for enhancing the quality of experience in digital media products. However, the technical tools available for AR lacks in providing the rich understanding required to design interactive digital experiences quickly and efficiently. In partnership with AWE Company Ltd, this research project will attempt at developing a context-aware Application Programming Interface (API) that can provide a semantic understanding of a user's surrounding by intelligently distributing the camera feed data from a user's device on to three separate sub-modules for semantic understanding: building facade segmentation, floor plan creation, and object localization. Through understanding the user's context (i.e. the requirement of the understanding of the aforementioned semantics), the proposed API can reduce the computational and data overhead required to run the neural network-based systems on the cloud. The proposed project will employ Distributed Deep Neural Network (DDNN) design principles to carefully distribute the computational task between the clients and the cloud, while building the semantic understanding stack on top of available technology tools such as ARCore/ARKit, so that AWE's software developers can easily integrate the proposed solution into their product development pipeline.
The proposed API will result in a robust framework for quick distribution of digital twins projects that AWE plans to roll out for many of its clients within the next two years. The proposed research will help to position Canada as a leader in multimedia technologies, while the resultant technology transfer to Canadian industry will strengthen Canada's global competitiveness and create positive impacts to Canadian economy and society.