Canada Spends Logo

Explorez notre analyse du budget 2026

Grant: Discovery Grants Program - Individual

Institut national de la recherche scientifique

$28,000.00

Microphone Arrays for Immersive Voice Communications

EF 2023-24

Résumé
Immersive voice communication facilitates group collaborations and teleconferencing efficiently at lowcosts. It is becoming an integral part of modern communication networks. A key technical challengefor an immersive voice communication system is the ability to acquire high-fidelity acoustic, audio, andspeech signals while keeping spatial information of the sources intact so that it is possible for the remote listenerto sense the acoustic environment, follow a panel of talkers, and distinguish them by listening to thereproduction of the signals. To acquire high-fidelity speech and preserve the sound realism, it is necessaryto use microphone arrays. Although microphone array processing has been studied for a few decades,existing techniques produce frequency-dependent responses, which may cause much distortion to the signalof interest, noise, interferences, and sound realism; as a result, they are not sufficient forimmersive communication systems. This proposal is therefore organized to address the technical issues ofmicrophone array design and beamforming and develop theory, methods, and technologies that can allowacquisition, processing, and reproduction of high-fidelity spatial sound for immersive voice communicationsystems. This proposal contains the following key technical innovations and merits.1) A fundamental formulation of and a signal processing theory for frequency-invariant microphonearray design and beamforming for signals with frequency range from 60 Hz to 20 kHz.2) A new generation of technologies for linear microphone array design and frequency-invariant androbust beamforming.3) A new generation of circular and spherical microphone array design and frequency-invariant androbust beamforming algorithms.4) A signal processing theory for optimization of microphone array geometry with some given performancecriteria.5) A signal processing theory and a new generation of technologies for distributed microphone arrayprocessing.6) A practical system that takes ubiquitous acoustic signals as input and produces high-fidelity outputsignals with source realism and identifiable source identities.It is clear that the proposed research is in the heart of immersive voice communication. The resultingtechnologies can have a broad range of applications besides immersive voice communication includingtelecollaboration, human-machine interfaces, acoustic surveillance, security, smartphones, smart homesystems, tablet PCs, hearing aids, etc. As the demand of microphone arrays is increasing, the researchresult of this project will have undoubtedly a profound impact on the society and it will be truly indispensable.
Programme
Discovery Grants Program - Individual
Emplacement
Quebec, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data

Tel que publié

Application id
RGPIN-2018-05223
Name nom
Benesty, Jacob
Department département
EMT
Organization id
56
Institution établissement
Institut national de la recherche scientifique
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2023
Competition year année de concours
2018
Award amount
28000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1510
Committee name en
Electrical and Computer Engineering
Committee name fr
Génie électrique et informatique
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2713
Research subject group en
Information technology
Research subject group fr
Algorithms
Research subject en
Technologie de l'information
Research subject fr
Algorithmes
Application title
Microphone Arrays for Immersive Voice Communications
Keyword
Acoustics; Array Processing; Audio; Microphones; Signal Enhancement; Signal Processing; Speech Processing; Speech Technologies; Telecommunications
Application summary
Immersive voice communication facilitates group collaborations and teleconferencing efficiently at lowcosts. It is becoming an integral part of modern communication networks. A key technical challengefor an immersive voice communication system is the ability to acquire high-fidelity acoustic, audio, andspeech signals while keeping spatial information of the sources intact so that it is possible for the remote listenerto sense the acoustic environment, follow a panel of talkers, and distinguish them by listening to thereproduction of the signals. To acquire high-fidelity speech and preserve the sound realism, it is necessaryto use microphone arrays. Although microphone array processing has been studied for a few decades,existing techniques produce frequency-dependent responses, which may cause much distortion to the signalof interest, noise, interferences, and sound realism; as a result, they are not sufficient forimmersive communication systems. This proposal is therefore organized to address the technical issues ofmicrophone array design and beamforming and develop theory, methods, and technologies that can allowacquisition, processing, and reproduction of high-fidelity spatial sound for immersive voice communicationsystems. This proposal contains the following key technical innovations and merits.1) A fundamental formulation of and a signal processing theory for frequency-invariant microphonearray design and beamforming for signals with frequency range from 60 Hz to 20 kHz.2) A new generation of technologies for linear microphone array design and frequency-invariant androbust beamforming.3) A new generation of circular and spherical microphone array design and frequency-invariant androbust beamforming algorithms.4) A signal processing theory for optimization of microphone array geometry with some given performancecriteria.5) A signal processing theory and a new generation of technologies for distributed microphone arrayprocessing.6) A practical system that takes ubiquitous acoustic signals as input and produces high-fidelity outputsignals with source realism and identifiable source identities.It is clear that the proposed research is in the heart of immersive voice communication. The resultingtechnologies can have a broad range of applications besides immersive voice communication includingtelecollaboration, human-machine interfaces, acoustic surveillance, security, smartphones, smart homesystems, tablet PCs, hearing aids, etc. As the demand of microphone arrays is increasing, the researchresult of this project will have undoubtedly a profound impact on the society and it will be truly indispensable.