Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Discovery Grants Program - Individual

University of Ottawa

$22,000.00

""Advanced Keying, Compression and Watermarking of 3D Video Signals""

FY 2016-17

Summary
3D TV programs are an irreversible trend for future TV broadcasting. Research on 3D video processing has become an extremely hot topic in recent years. We, as researchers in the field of video processing, must get ready and prepared for the immediate future of video processing. We should research and develop advanced algorithms to produce, process, store, and transmit 3D TV contents. In this project proposal, we will focus our research on keying, compression and watermarking of 3D video signals. The research results can be extended to multiview 3D video processing. Chroma keying is a technique for compositing two images or frames together in which background colors from one image is removed, revealing another image behind it. To the best of our knowledge, there is no keying algorithm that can process semi-transparency sufficiently well. Applying the technique to video signal is even harder since extracted mattes on sequential frames must be both spatially and temporally coherent. We will research and develop advanced real-time 2D/3D video keying algorithms by using depth information in addition to chroma, spatial and temporal information. Depth map generation is indispensable for 2D to 3D video conversion and 3D video representation using depth maps. We will research and develop advanced algorithms to generate depth map for 2D/3D video signals, and SSIM based quality evaluation algorithms for keying and depth map. We will use the new quality metric to guide the generation process of keying and depth map. The 3D video representation using depth maps (called 2D plus depth) will become more efficient, which represents the stereoscopic information using the monocular image and its associated depth information. We will research and develop advanced depth map compression algorithms for 3D video compression. The proposed research on 3D video keying, compression and watermarking will definitely benefit the video industry of Canada.
Program
Discovery Grants Program - Individual
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
227781-2012
Name nom
Zhao, Jiying
Department département
Electrical Engineering and Computer Science , School of
Organization id
28
Institution établissement
University of Ottawa
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2016
Competition year année de concours
2012
Award amount
22000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2708
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Image processing
Research subject fr
Traitement des images
Partie
5
Nb partie
5
Application title
""Advanced Keying, Compression and Watermarking of 3D Video Signals""
Keyword
NSERC
Application summary
3D TV programs are an irreversible trend for future TV broadcasting. Research on 3D video processing has become an extremely hot topic in recent years. We, as researchers in the field of video processing, must get ready and prepared for the immediate future of video processing. We should research and develop advanced algorithms to produce, process, store, and transmit 3D TV contents. In this project proposal, we will focus our research on keying, compression and watermarking of 3D video signals. The research results can be extended to multiview 3D video processing. Chroma keying is a technique for compositing two images or frames together in which background colors from one image is removed, revealing another image behind it. To the best of our knowledge, there is no keying algorithm that can process semi-transparency sufficiently well. Applying the technique to video signal is even harder since extracted mattes on sequential frames must be both spatially and temporally coherent. We will research and develop advanced real-time 2D/3D video keying algorithms by using depth information in addition to chroma, spatial and temporal information. Depth map generation is indispensable for 2D to 3D video conversion and 3D video representation using depth maps. We will research and develop advanced algorithms to generate depth map for 2D/3D video signals, and SSIM based quality evaluation algorithms for keying and depth map. We will use the new quality metric to guide the generation process of keying and depth map. The 3D video representation using depth maps (called 2D plus depth) will become more efficient, which represents the stereoscopic information using the monocular image and its associated depth information. We will research and develop advanced depth map compression algorithms for 3D video compression. The proposed research on 3D video keying, compression and watermarking will definitely benefit the video industry of Canada.