Grant: Discovery Grants Program - Individual
Carleton University
$31,000.00
Signal Separation using Multichannel/Multimodal Side Information
EF 2015-16
Résumé
The aim of signal separation is to recover source signals from one or more signal mixtures. These mixtures can come from a multitude of domains, including speech mixtures for the so-called cocktail party problem, musical recordings of multiple instruments and/or vocals, electroencephalograph (EEG) signals from the electrical activity of the brain, maternal/fetal electrocardiograph (ECG) mixtures when measuring surface potentials for fetal monitoring, electromyography (EMG) signals from mixtures of motor unit action potentials in muscles, various astronomical datasets with mixtures of weak astronomical sources versus background, and radar or sonar systems. Quite often, source separation is an inductive inference problem where the problem is highly underdetermined such that limited information exists for hoping to find a unique solution. Source separation problems may come with varying levels of information, including single channel mixtures, multichannel mixtures, or mixtures that are accompanied with side metadata that may help with the separation. For example, a music performance could be recorded by a single microphone (single channel), by multiple microphones distributed around the room (multichannel with spatial diversity), or access may be had to the musical score and instrument types (side metadata information).
The focus for this proposal is to research develop advanced source separation techniques that multichannel and multimodal metadata as side information to improve the quality in source separation. The signal processing research will concentrate on incorporating multichannel and side information into the source separation problem and in evaluating the impact of such side metadata information. Of particular interest is when there are lack of time alignment information wit the metadata, small variations in time-frequency or sparsity information between the mixtures and the metadata, effects of short-time non-stationarities in the source signals being separated, and use of sparsity constraints in multiple domains.
These signal separation characteristics will be research and studied under various applications, including speech, vocals/instrument separation, and EMG signal decomposition, but, the key research focus will be on the core components of source separation in multichannel mixtures with side metadata information. Some of the anticipated outcomes are as follows. First, in the vocal/instrument separation space, we expect to be able to take a musical recording, likely as a stereo multichannel recording, along with side metadata, which could include the musical score, sound samples of the instruments in the performance, an example performance of the piece by a secondary musician, a list of lyrics, a MIDI file, or other types of metadata, and be able to separate the individual instruments in the recording to either isolate or suppress individual instruments. In the EMG signal decomposition space, we expect to be able to take multichannel EMG recordings and determine firing times of individual motor units in the muscle and the corresponding shape of the motor unit action potentials. In the fetal ECG separation space, we expect to be able take a multichannel mixtures containing the stronger maternal ECG and weaker fetal ECG, and be able to suppress the stronger maternal ECG signal in an improved fashion. The proposed core research in signal separation will have wider applicability, where these examples would be used to validate the techniques and determine other limitations that may present themselves in one domain but not another.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2014-03983
Name nom
Dansereau, Richard
Department département
Systems and Computer Engineering
Organization id
23
Institution établissement
Carleton University
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2015
Competition year année de concours
2014
Award amount
31000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1510
Committee name en
Electrical and Computer Engineering
Committee name fr
Génie électrique et informatique
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
2514
Research subject group en
Electrical and electronic engineering
Research subject group fr
Génie électrique et électronique
Research subject en
Digital signal processing
Research subject fr
Traitement des signaux numériques
Partie
2
Nb partie
5
Application title
Signal Separation using Multichannel/Multimodal Side Information
Keyword
NSERC
Application summary
The aim of signal separation is to recover source signals from one or more signal mixtures. These mixtures can come from a multitude of domains, including speech mixtures for the so-called cocktail party problem, musical recordings of multiple instruments and/or vocals, electroencephalograph (EEG) signals from the electrical activity of the brain, maternal/fetal electrocardiograph (ECG) mixtures when measuring surface potentials for fetal monitoring, electromyography (EMG) signals from mixtures of motor unit action potentials in muscles, various astronomical datasets with mixtures of weak astronomical sources versus background, and radar or sonar systems. Quite often, source separation is an inductive inference problem where the problem is highly underdetermined such that limited information exists for hoping to find a unique solution. Source separation problems may come with varying levels of information, including single channel mixtures, multichannel mixtures, or mixtures that are accompanied with side metadata that may help with the separation. For example, a music performance could be recorded by a single microphone (single channel), by multiple microphones distributed around the room (multichannel with spatial diversity), or access may be had to the musical score and instrument types (side metadata information).
The focus for this proposal is to research develop advanced source separation techniques that multichannel and multimodal metadata as side information to improve the quality in source separation. The signal processing research will concentrate on incorporating multichannel and side information into the source separation problem and in evaluating the impact of such side metadata information. Of particular interest is when there are lack of time alignment information wit the metadata, small variations in time-frequency or sparsity information between the mixtures and the metadata, effects of short-time non-stationarities in the source signals being separated, and use of sparsity constraints in multiple domains.
These signal separation characteristics will be research and studied under various applications, including speech, vocals/instrument separation, and EMG signal decomposition, but, the key research focus will be on the core components of source separation in multichannel mixtures with side metadata information. Some of the anticipated outcomes are as follows. First, in the vocal/instrument separation space, we expect to be able to take a musical recording, likely as a stereo multichannel recording, along with side metadata, which could include the musical score, sound samples of the instruments in the performance, an example performance of the piece by a secondary musician, a list of lyrics, a MIDI file, or other types of metadata, and be able to separate the individual instruments in the recording to either isolate or suppress individual instruments. In the EMG signal decomposition space, we expect to be able to take multichannel EMG recordings and determine firing times of individual motor units in the muscle and the corresponding shape of the motor unit action potentials. In the fetal ECG separation space, we expect to be able take a multichannel mixtures containing the stronger maternal ECG and weaker fetal ECG, and be able to suppress the stronger maternal ECG signal in an improved fashion. The proposed core research in signal separation will have wider applicability, where these examples would be used to validate the techniques and determine other limitations that may present themselves in one domain but not another.