Grant: Engage Grants Program
Concordia University
$25,000.00
Multi-Speaker Separation in Reverberant Room Using Velocity-Based Microphone
EF 2018-19
Résumé
Audio signal separation has found many applications in electrical and computer engineering fields, such as*automatic speech recognition, voice communication, hearing aids etc. These applications have driven the need*of directional microphone solutions that can pick up only the sound from the desired speaker while suppressing*the voices from other speakers as well as the background noise. Conventional solutions using array of*pressure-based microphones combined with digital signal processing (DSP) techniques do not work well in*space-constrained applications where the captured sound contains mixed voices and ambient noises. Soundskrit*is developing a revolutionary fiber-based directional microphone technology that can directly measure the*particle velocity of an incoming sound wave. Currently, the Soundskrit R&D team lacks signal processing*expertise that is required to develop sound separation software based on the real data acquired by the new*fiber-based microphone in a multi-speaker and reverberant environment.*In this project, we intend to develop DSP algorithms for the Soundskrit's prototype to separate multiple moving*speakers in a reverberant room. The project has two main objectives: (1) localizing active sources in a*reverberant room using sound intensity, and (2) beamforming toward the desired speaker to attenuate unwanted*sounds and noise. The proposed work is divided into three phases. Phase 1 is to build a baseline system to*study the performance of the existing solutions via computer simulation. Phase 2 is to develop DSP algorithms*for the Soundskrit prototype to achieve the objectives in a simulated environment and compare it with the*solutions in Phase 1. In Phase 3, real data will be collected using Soundskrit's prototype in several reverberant*rooms, and the algorithm will be tested and evaluated in real-time. The research results achieved in this project*will be transferred to Soundskrit through a detailed technical report including all software codes and hardware*design.
Programme
Engage Grants Program
Bénéficiaire
Emplacement
Quebec, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
531229-2018
Name nom
Zhu, WeiPing
Department département
Electrical and Computer Engineering
Organization id
70
Institution établissement
Concordia University
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2018
Competition year année de concours
2018
Award amount
25000
Program id
EGP
Program name en
Engage Grants Program
Program name fr
Programme de subventions d'engagement partenariat
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
1552
Committee name en
Quebec Internal Decision Committee
Committee name fr
Comité de décision interne pour le Québec
Area of application code
800
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information and communication services
Area of application fr
Services d'information et de télécommunications
Research subject code
2514
Research subject group en
Electrical and electronic engineering
Research subject group fr
Génie électrique et électronique
Research subject en
Digital signal processing
Research subject fr
Traitement des signaux numériques
Partie
1
Nb partie
1
Application title
Multi-Speaker Separation in Reverberant Room Using Velocity-Based Microphone
Keyword
NSERC
Application summary
Audio signal separation has found many applications in electrical and computer engineering fields, such as*automatic speech recognition, voice communication, hearing aids etc. These applications have driven the need*of directional microphone solutions that can pick up only the sound from the desired speaker while suppressing*the voices from other speakers as well as the background noise. Conventional solutions using array of*pressure-based microphones combined with digital signal processing (DSP) techniques do not work well in*space-constrained applications where the captured sound contains mixed voices and ambient noises. Soundskrit*is developing a revolutionary fiber-based directional microphone technology that can directly measure the*particle velocity of an incoming sound wave. Currently, the Soundskrit R&D team lacks signal processing*expertise that is required to develop sound separation software based on the real data acquired by the new*fiber-based microphone in a multi-speaker and reverberant environment.*In this project, we intend to develop DSP algorithms for the Soundskrit's prototype to separate multiple moving*speakers in a reverberant room. The project has two main objectives: (1) localizing active sources in a*reverberant room using sound intensity, and (2) beamforming toward the desired speaker to attenuate unwanted*sounds and noise. The proposed work is divided into three phases. Phase 1 is to build a baseline system to*study the performance of the existing solutions via computer simulation. Phase 2 is to develop DSP algorithms*for the Soundskrit prototype to achieve the objectives in a simulated environment and compare it with the*solutions in Phase 1. In Phase 3, real data will be collected using Soundskrit's prototype in several reverberant*rooms, and the algorithm will be tested and evaluated in real-time. The research results achieved in this project*will be transferred to Soundskrit through a detailed technical report including all software codes and hardware*design.