Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Engage Grants Program

McMaster University

$25,000.00

Rush in 3D

FY 2015-16

Summary
In cooperation with Anthem / SRO , the applicant wishes to lay the groundwork for a free-viewpoint video. This would allow users to visualize the performance of the iconic Canadian rock band Rush in 3 dimensions, with the ability to pilot a virtual drone-like camera around a rendered 3D version of the stage. Development of the video would begin by using video of the musicians as they perform on stage, from a large array of cameras embedded in and around the stage. This step has already been performed, in collaboration with GoPro Inc. and CamDo Inc. From the 50 different points of view recorded at one concert (Calgary, 15 July 2015), we will refine 3D reconstruction techniques to reconstruct their performance as an animated 3D model. Furthermore, the video capture is noisy (vibrations of all kinds, partly obscured views, alternating bright and dark lighting, fireworks, etc), and thus novel machine learning algorithms will be used to filter out this noise. Anthem / SRO wishes to partner with McMaster as there are rather significant technical hurdles to overcome in all stages of the development of such a software application. They do not have either the expertise or technology for the visual aspects. Dr. Carette, through his G-ScalE lab, does.
Program
Engage Grants Program
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
488542-2015
Name nom
Carette, Jacques
Department département
Computing and Software
Organization id
27
Institution établissement
McMaster University
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2015
Competition year année de concours
2015
Award amount
25000
Program id
EGP
Program name en
Engage Grants Program
Program name fr
Programme de subventions d'engagement partenariat
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
1553
Committee name en
Ontario Internal Decision Committee
Committee name fr
Comité de décision interne pour l'Ontario
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
2708
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Image processing
Research subject fr
Traitement des images
Partie
1
Nb partie
1
Application title
Rush in 3D
Keyword
NSERC
Application summary
In cooperation with Anthem / SRO , the applicant wishes to lay the groundwork for a free-viewpoint video. This would allow users to visualize the performance of the iconic Canadian rock band Rush in 3 dimensions, with the ability to pilot a virtual drone-like camera around a rendered 3D version of the stage. Development of the video would begin by using video of the musicians as they perform on stage, from a large array of cameras embedded in and around the stage. This step has already been performed, in collaboration with GoPro Inc. and CamDo Inc. From the 50 different points of view recorded at one concert (Calgary, 15 July 2015), we will refine 3D reconstruction techniques to reconstruct their performance as an animated 3D model. Furthermore, the video capture is noisy (vibrations of all kinds, partly obscured views, alternating bright and dark lighting, fireworks, etc), and thus novel machine learning algorithms will be used to filter out this noise. Anthem / SRO wishes to partner with McMaster as there are rather significant technical hurdles to overcome in all stages of the development of such a software application. They do not have either the expertise or technology for the visual aspects. Dr. Carette, through his G-ScalE lab, does.