Canada Spends Logo

Explorez notre analyse du budget 2026

Grant: Discovery Grants Program - Individual

Queen's University

$28,000.00

Anthropomorphic and efficient multimedia communication

EF 2014-15

Résumé
The aim of our research is to devise means to build machines that perform more like humans in interacting with humans and to perform more efficiently in communicating human-targeted media content. A human listening to another person's speech can recognize more than just the spoken words. From the speech signal alone, the listener can instinctively extract paralinguistic information such as the speaker's accent, gender, age, identity, emotion, and even health and mental state. Humans can also instinctively judge the quality of the speech signal. We aim to develop speech processing algorithms that will make machines better able to recognize the emotion in speech signals and to judge how intelligible is a given speech signal. The former will make machines better able to understand human speech and the latter will equip machines with a capability to improve the quality of distorted speech signals. We also propose to devise methods to enable machines to make human-like judgments on the visual quality of a given video signal. Lastly, we propose to research methods to enable signal sensors to communicate without the aid of a network infrastructure. Advanced coding schemes will be developed to provide error resilient communication while conserving energy. The proposed research program will advance machine intelligence and communication technologies that can be used, for instance, to build energy-efficient sensors that make up a ""smart"" wearable audio-visual communication system. Such a system can integrate the functions of wireless headsets, hearing aids, microphones, speech recognizers, and cameras. Both environmentally sensed and electronically received audio and visual signals can be processed to optimize the audio-visual experience of the wearer and/or remote recipients. For instance, audio signals can be processed to ameliorate effects of acoustic interferences and to best suit the hearing profile of each ear. Audio-visual signals can be processed for the best delivered user experience commensurate with the communication resources available, such as battery and communication channel capacity. The built-in speech recognizer can orchestrate services with a human touch by reacting to speech affects.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data

Tel que publié

Application id
121761-2011
Name nom
Chan, WaiYip(Geoffrey)
Department département
Electrical and Computer Engineering
Organization id
29
Institution établissement
Queen's University
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2014
Competition year année de concours
2011
Award amount
28000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1510
Committee name en
Electrical and Computer Engineering
Committee name fr
Génie électrique et informatique
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
2514
Research subject group en
Electrical and electronic engineering
Research subject group fr
Génie électrique et électronique
Research subject en
Digital signal processing
Research subject fr
Traitement des signaux numériques
Partie
4
Nb partie
5
Application title
Anthropomorphic and efficient multimedia communication
Keyword
NSERC
Application summary
The aim of our research is to devise means to build machines that perform more like humans in interacting with humans and to perform more efficiently in communicating human-targeted media content. A human listening to another person's speech can recognize more than just the spoken words. From the speech signal alone, the listener can instinctively extract paralinguistic information such as the speaker's accent, gender, age, identity, emotion, and even health and mental state. Humans can also instinctively judge the quality of the speech signal. We aim to develop speech processing algorithms that will make machines better able to recognize the emotion in speech signals and to judge how intelligible is a given speech signal. The former will make machines better able to understand human speech and the latter will equip machines with a capability to improve the quality of distorted speech signals. We also propose to devise methods to enable machines to make human-like judgments on the visual quality of a given video signal. Lastly, we propose to research methods to enable signal sensors to communicate without the aid of a network infrastructure. Advanced coding schemes will be developed to provide error resilient communication while conserving energy. The proposed research program will advance machine intelligence and communication technologies that can be used, for instance, to build energy-efficient sensors that make up a ""smart"" wearable audio-visual communication system. Such a system can integrate the functions of wireless headsets, hearing aids, microphones, speech recognizers, and cameras. Both environmentally sensed and electronically received audio and visual signals can be processed to optimize the audio-visual experience of the wearer and/or remote recipients. For instance, audio signals can be processed to ameliorate effects of acoustic interferences and to best suit the hearing profile of each ear. Audio-visual signals can be processed for the best delivered user experience commensurate with the communication resources available, such as battery and communication channel capacity. The built-in speech recognizer can orchestrate services with a human touch by reacting to speech affects.