Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Engage Grants Program

École de technologie supérieure

$22,020.00

Real-time conversion of multichannel surround sound to binaural head-tracked gaming headset

FY 2013-14

Summary
The head-mounted-displays (HMD) under development by the Canadian company True Player Gear Inc.immerses the player in a stereoscopic 3D game scene and also acts as the gaming joystick so that the player caninteract with the game through his/her head pose. This HMD is therefore backward-compatible with anyHDMI gaming console and provide a much greater visual immersion: when the player turns his head to theside, the console natively renders the new visual scene that is then played back into the HMD. One problemoccurs with the rendering of the game audio scene: the game audio scene is provided by the gaming console asa multichannel surround sound and is typically intended to be played back on a stationary 5.1 home theatersystem that assumes that a television screen is located right between the two front speakers. As such, thecurrent audio 5.1 surround rendering is highly incompatible with the envisioned HMD where the head-mounteddisplays are in constant displacement relative to the fixed loudspeakers. Besides, the HMD is a personal deviceand includes a pair of earphones that can only play back a stereo audio signal. It is therefore necessary todevelop new algorithms dedicated to the developed HMD (a) to accurately determine the player's head positionand (b) to convert the multichannel audio signal to a stereo signal to be played back by the stereo headsetembedded on the HMD while maintaining the surround sound effects and correcting for the head pose.
Program
Engage Grants Program
Location
Quebec, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
451396-2013
Name nom
Voix, Jeremie
Department département
Génie mécanique
Organization id
53
Institution établissement
École de technologie supérieure
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2013
Competition year année de concours
2013
Award amount
22020
Program id
EGP
Program name en
Engage Grants Program
Program name fr
Programme de subventions d'engagement partenariat
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
1552
Committee name en
Quebec Internal Decision Committee
Committee name fr
Comité de décision interne pour le Québec
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
3109
Research subject group en
Physics
Research subject group fr
Physique
Research subject en
Acoustics
Research subject fr
Acoustique
Partie
1
Nb partie
1
Application title
Real-time conversion of multichannel surround sound to binaural head-tracked gaming headset
Keyword
NSERC
Application summary
The head-mounted-displays (HMD) under development by the Canadian company True Player Gear Inc.immerses the player in a stereoscopic 3D game scene and also acts as the gaming joystick so that the player caninteract with the game through his/her head pose. This HMD is therefore backward-compatible with anyHDMI gaming console and provide a much greater visual immersion: when the player turns his head to theside, the console natively renders the new visual scene that is then played back into the HMD. One problemoccurs with the rendering of the game audio scene: the game audio scene is provided by the gaming console asa multichannel surround sound and is typically intended to be played back on a stationary 5.1 home theatersystem that assumes that a television screen is located right between the two front speakers. As such, thecurrent audio 5.1 surround rendering is highly incompatible with the envisioned HMD where the head-mounteddisplays are in constant displacement relative to the fixed loudspeakers. Besides, the HMD is a personal deviceand includes a pair of earphones that can only play back a stereo audio signal. It is therefore necessary todevelop new algorithms dedicated to the developed HMD (a) to accurately determine the player's head positionand (b) to convert the multichannel audio signal to a stereo signal to be played back by the stereo headsetembedded on the HMD while maintaining the surround sound effects and correcting for the head pose.
École de technologie supérieure - $22,020 Grant (2013… | Canada Spends