Grant: Discovery Grants Program - Individual
Institut national de la recherche scientifique
$28,000.00
Microphone Arrays for Immersive Voice Communications
EF 2020-21
Résumé
Immersive voice communication facilitates group collaborations and teleconferencing efficiently at low
costs. It is becoming an integral part of modern communication networks. A key technical challenge
for an immersive voice communication system is the ability to acquire high-fidelity acoustic, audio, and
speech signals while keeping spatial information of the sources intact so that it is possible for the remote listener
to sense the acoustic environment, follow a panel of talkers, and distinguish them by listening to the
reproduction of the signals. To acquire high-fidelity speech and preserve the sound realism, it is necessary
to use microphone arrays. Although microphone array processing has been studied for a few decades,
existing techniques produce frequency-dependent responses, which may cause much distortion to the signal
of interest, noise, interferences, and sound realism; as a result, they are not sufficient for
immersive communication systems. This proposal is therefore organized to address the technical issues of
microphone array design and beamforming and develop theory, methods, and technologies that can allow
acquisition, processing, and reproduction of high-fidelity spatial sound for immersive voice communication
systems. This proposal contains the following key technical innovations and merits.
1) A fundamental formulation of and a signal processing theory for frequency-invariant microphone
array design and beamforming for signals with frequency range from 60 Hz to 20 kHz.
2) A new generation of technologies for linear microphone array design and frequency-invariant and
robust beamforming.
3) A new generation of circular and spherical microphone array design and frequency-invariant and
robust beamforming algorithms.
4) A signal processing theory for optimization of microphone array geometry with some given performance
criteria.
5) A signal processing theory and a new generation of technologies for distributed microphone array
processing.
6) A practical system that takes ubiquitous acoustic signals as input and produces high-fidelity output
signals with source realism and identifiable source identities.
It is clear that the proposed research is in the heart of immersive voice communication. The resulting
technologies can have a broad range of applications besides immersive voice communication including
telecollaboration, human-machine interfaces, acoustic surveillance, security, smartphones, smart home
systems, tablet PCs, hearing aids, etc. As the demand of microphone arrays is increasing, the research
result of this project will have undoubtedly a profound impact on the society and it will be truly indispensable.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Quebec, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2018-05223
Name nom
Benesty, Jacob
Department département
EMT
Organization id
56
Institution établissement
Institut national de la recherche scientifique
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2020
Competition year année de concours
2018
Award amount
28000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1510
Committee name en
Electrical and Computer Engineering
Committee name fr
Génie électrique et informatique
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2514
Research subject group en
Electrical and electronic engineering
Research subject group fr
Génie électrique et électronique
Research subject en
Digital signal processing
Research subject fr
Traitement des signaux numériques
Installment
inst:3-5
Partie
3
Nb partie
5
Application title
Microphone Arrays for Immersive Voice Communications
Keyword
NSERC
Application summary
Immersive voice communication facilitates group collaborations and teleconferencing efficiently at low
costs. It is becoming an integral part of modern communication networks. A key technical challenge
for an immersive voice communication system is the ability to acquire high-fidelity acoustic, audio, and
speech signals while keeping spatial information of the sources intact so that it is possible for the remote listener
to sense the acoustic environment, follow a panel of talkers, and distinguish them by listening to the
reproduction of the signals. To acquire high-fidelity speech and preserve the sound realism, it is necessary
to use microphone arrays. Although microphone array processing has been studied for a few decades,
existing techniques produce frequency-dependent responses, which may cause much distortion to the signal
of interest, noise, interferences, and sound realism; as a result, they are not sufficient for
immersive communication systems. This proposal is therefore organized to address the technical issues of
microphone array design and beamforming and develop theory, methods, and technologies that can allow
acquisition, processing, and reproduction of high-fidelity spatial sound for immersive voice communication
systems. This proposal contains the following key technical innovations and merits.
1) A fundamental formulation of and a signal processing theory for frequency-invariant microphone
array design and beamforming for signals with frequency range from 60 Hz to 20 kHz.
2) A new generation of technologies for linear microphone array design and frequency-invariant and
robust beamforming.
3) A new generation of circular and spherical microphone array design and frequency-invariant and
robust beamforming algorithms.
4) A signal processing theory for optimization of microphone array geometry with some given performance
criteria.
5) A signal processing theory and a new generation of technologies for distributed microphone array
processing.
6) A practical system that takes ubiquitous acoustic signals as input and produces high-fidelity output
signals with source realism and identifiable source identities.
It is clear that the proposed research is in the heart of immersive voice communication. The resulting
technologies can have a broad range of applications besides immersive voice communication including
telecollaboration, human-machine interfaces, acoustic surveillance, security, smartphones, smart home
systems, tablet PCs, hearing aids, etc. As the demand of microphone arrays is increasing, the research
result of this project will have undoubtedly a profound impact on the society and it will be truly indispensable.