Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Discovery Grants Program - Individual

University of Alberta

$87,080.00

Human Perception & Intelligence in Multimedia Computing

FY 2023-24

Summary
Human Perception and Intelligence in Multimedia Computing Human intelligence has been driving the advancement of technology. Current state-of-the-art in the research community focuses on simulating human intelligence in a machine executable form. Machine learning methods show promise but also bring challenges due to massive training data and lengthy training time. To address these issues, it is necessary to optimize the training features using robust computer vision and signal processing techniques before the machine learning step. Otherwise, noisy and irrelevant input will lead to exponential computational time or even non-convergence in the machine training process. My research goal is to remove redundant data, identify dominant features, and introduce unsupervised algorithms to deliver intelligent multimedia computing results. Selecting dominant features in multimedia, e.g., image, video, signal and graphics, requires data and pattern analysis (from 1D to higher dimensions) in the spatial and temporal domain. It has been shown in the literature that a computational model incorporating human perceptual criteria, e.g., color and contrast sensitivity, is effective in feature discovery, data discrimination and target recognition. To conduct research using the rapidly growing dynamic and complex multimedia data, I will extend my perceptually motivated models and focus on introducing efficient methods in Multimedia Quality Assessment, Noise Discrimination and Multi-Modal Fusion. Dimensionality Reduction techniques will also be developed to optimize performance. Determination of Just-Noticeable-Difference (JND) is an important step when assessing output quality and discriminating noise. Application-specific JND threshold (or tolerance), e.g., for game applications or medical image analysis, needs to be defined in order to decide whether an output quality should be accepted or rejected. Multimedia data is represented as digital values in machines, while visual cue is interpreted based on the Human Visual System (HVS). A change in digital value may not be visible by the HVS, but such change can be an application alert. On the other hand, a visible change to the HVS is not necessarily significant for an application. The result of my study will bring further insight into the correspondence between quantitative computer output and qualitative visual assessment, and report impact which is significant to an application. My work on quality assessment, noise filtering and multi-modal fusion will help track changing patterns in dynamic multimedia data. Applications will include smart city monitoring, e.g., surveillance and target tracking, and the prediction of structural or geographical changes before disasters occur, e.g., landslides.
Program
Discovery Grants Program - Individual
Location
Alberta, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
RGPIN-2018-04367
Name nom
Cheng, Irene
Department département
Computing Science - Computing Science
Organization id
9
Institution établissement
University of Alberta
Province en
Alberta
Province fr
Alberta
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2023
Competition year année de concours
2018
Award amount
87080
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
703
Area of application group en
Transportation systems and services
Area of application group fr
Services et systèmes de transport
Area of application en
Aerospace
Area of application fr
Aérospatial
Research subject code
7000
Research subject group en
Other studies in natural sciences and engineering
Research subject group fr
Other studies in natural sciences and engineering
Research subject en
Autres études en sciences naturelles et en génie
Research subject fr
Autres études en sciences naturelles et en génie
Application title
Human Perception & Intelligence in Multimedia Computing
Keyword
human perceptual criteria; intelligent feature learning; just-noticeable-difference (JND); layer-wise output quality control; multimedia data fusion; multimedia data quality assessment; multimedia signal and pattern recognition; multi-modal data analysis; noise subtraction; reverse-fusion
Application summary
Human Perception and Intelligence in Multimedia Computing Human intelligence has been driving the advancement of technology. Current state-of-the-art in the research community focuses on simulating human intelligence in a machine executable form. Machine learning methods show promise but also bring challenges due to massive training data and lengthy training time. To address these issues, it is necessary to optimize the training features using robust computer vision and signal processing techniques before the machine learning step. Otherwise, noisy and irrelevant input will lead to exponential computational time or even non-convergence in the machine training process. My research goal is to remove redundant data, identify dominant features, and introduce unsupervised algorithms to deliver intelligent multimedia computing results. Selecting dominant features in multimedia, e.g., image, video, signal and graphics, requires data and pattern analysis (from 1D to higher dimensions) in the spatial and temporal domain. It has been shown in the literature that a computational model incorporating human perceptual criteria, e.g., color and contrast sensitivity, is effective in feature discovery, data discrimination and target recognition. To conduct research using the rapidly growing dynamic and complex multimedia data, I will extend my perceptually motivated models and focus on introducing efficient methods in Multimedia Quality Assessment, Noise Discrimination and Multi-Modal Fusion. Dimensionality Reduction techniques will also be developed to optimize performance. Determination of Just-Noticeable-Difference (JND) is an important step when assessing output quality and discriminating noise. Application-specific JND threshold (or tolerance), e.g., for game applications or medical image analysis, needs to be defined in order to decide whether an output quality should be accepted or rejected. Multimedia data is represented as digital values in machines, while visual cue is interpreted based on the Human Visual System (HVS). A change in digital value may not be visible by the HVS, but such change can be an application alert. On the other hand, a visible change to the HVS is not necessarily significant for an application. The result of my study will bring further insight into the correspondence between quantitative computer output and qualitative visual assessment, and report impact which is significant to an application. My work on quality assessment, noise filtering and multi-modal fusion will help track changing patterns in dynamic multimedia data. Applications will include smart city monitoring, e.g., surveillance and target tracking, and the prediction of structural or geographical changes before disasters occur, e.g., landslides.
University of Alberta - $87,080 Grant (2023-24) | Canada Spends