Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Strategic Projects - Group

McMaster University

$146,000.00

Multiview Video Coding, Processing and Applications

FY 2009-10

Summary
3D imaging and broadcasting technologies have drawn a great deal of attention from the industry and the research community, and represent an important future growth area of digital media industry and services. These technologies aim to offer consumers much enhanced and immersive experience in watching videos, and therefore could lead to a multitude of new multimedia applications for education, medicine, surveillance and entertainment. One way to achieve 3D imaging is to use multi-view video (MVV), where the system uses several cameras to acquire multiple video sequences of the same scene simultaneously. The data are then compressed and transmitted to the users. In this project, we will study and develop algorithms for multi-view video coding, 3D modeling, multi-view video processing and analysis, and multi-view based resolution enhancement. In particular we will devise compression algorithm(s) capable of removing all three types of redundancies in MVV sequences: intraframe, interframe and inter-view. Also, for the transmission of MVV via heterogeneous networks our MVV codec will be made scalable. Existing MVV systems require dedicated camera arrays and the corresponding expensive controlling hardware and software, making the mass deployment of these systems difficult and impractical, especially in the consumer markets. In this project, we propose a low-cost user-driven client-server alternative to these high-end 3D systems that can provide some basic multi-view video functionalities. The spatial, temporal and perspective redundancies in multi-view video suggest a great potential of improving video quality by superresolution techniques. Through motion estimation and geometric warping we can register multiple views in subpixel precision and upsample each of these views to a higher spatial resolution. We will formulate and investigate a new inverse problem for multi-view superresolution reconstruction, and develop an algorithm to solve the problem. This project will result in the development of new scientific knowledge and perhaps intellectual property that could ultimately be commercialized. Another important aspect of the project will be the development of highly qualified personnel.
Program
Strategic Projects - Group
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
380875-2009
Name nom
Shirani, Shahram
Department département
Electrical and Computer Engineering
Organization id
27
Institution établissement
McMaster University
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2009
Competition year année de concours
2009
Award amount
146000
Program id
STPGP
Program nane en
Strategic Projects - Group
Program name fr
Projets stratégiques - De groupe
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
1041
Committee name en
Strategic Projects Selection Panel - Communications and Information
Committee name fr
Comité de sélection des projets stratégiques - Communication et information
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
2708
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Image processing
Research subject fr
Traitement des images
Partie
1
Nb partie
3
Application title
Multiview Video Coding, Processing and Applications
Keyword
NA
Application summary
3D imaging and broadcasting technologies have drawn a great deal of attention from the industry and the research community, and represent an important future growth area of digital media industry and services. These technologies aim to offer consumers much enhanced and immersive experience in watching videos, and therefore could lead to a multitude of new multimedia applications for education, medicine, surveillance and entertainment. One way to achieve 3D imaging is to use multi-view video (MVV), where the system uses several cameras to acquire multiple video sequences of the same scene simultaneously. The data are then compressed and transmitted to the users. In this project, we will study and develop algorithms for multi-view video coding, 3D modeling, multi-view video processing and analysis, and multi-view based resolution enhancement. In particular we will devise compression algorithm(s) capable of removing all three types of redundancies in MVV sequences: intraframe, interframe and inter-view. Also, for the transmission of MVV via heterogeneous networks our MVV codec will be made scalable. Existing MVV systems require dedicated camera arrays and the corresponding expensive controlling hardware and software, making the mass deployment of these systems difficult and impractical, especially in the consumer markets. In this project, we propose a low-cost user-driven client-server alternative to these high-end 3D systems that can provide some basic multi-view video functionalities. The spatial, temporal and perspective redundancies in multi-view video suggest a great potential of improving video quality by superresolution techniques. Through motion estimation and geometric warping we can register multiple views in subpixel precision and upsample each of these views to a higher spatial resolution. We will formulate and investigate a new inverse problem for multi-view superresolution reconstruction, and develop an algorithm to solve the problem. This project will result in the development of new scientific knowledge and perhaps intellectual property that could ultimately be commercialized. Another important aspect of the project will be the development of highly qualified personnel.
McMaster University - $146,000 Grant (2009-10) | Canada Spends