Grant: Alliance Grants
Concordia University
$40,000.00
An Intelligent End-to-End Immersive Media Transport Over QUIC-enabled 5G Networks
FY 2024-25
Summary
Volumetric media (VM) such as volumetric video, mesh or point-cloud streaming technologies are the future of fully immersive VR/AR/XR experiences, which are becoming increasingly popular and are being used in a variety of applications (e.g., remote medicine, metaverse, and gaming). The challenges surrounding VM technologies are tremendous due to the high network bandwidth needed to produce high-quality and low-latency streams. Although, some studies have investigated aspects to mitigate these challenges, but mostly in isolation, and without considering holistically the end-to-end full transport workflow, especially in the context of a novel, mobile networks such as 5G. Designing an end-to-end VM transport with optimized quality of experience (QoE) is still a relatively new research topic and is challenging. This challenge is also confirmed by engineers from our industry partner, InterDigital, a pioneering R&D company in mobile/video technologies. The main goal of the proposed project is to explore and address key challenges in the transport of VM using QUIC, and to identify the best practices for using QUIC effectively in different scenarios, given the new network realities. In particular, we aim to address the following interrelated research tasks (T1-T6) holistically together: how to efficiently (T1) package, define and implement necessary QUIC-based (T2) payload formats and messages needed for signaling VM encoded using Volumetric Video-based Coding to allow (T3) flexible and robust quality adaptations and viewport predictions under extremely (T4) varying network conditions and with (T5) very low latency. We also aim to (T6) define and implement a mechanism on top of the proposed system to evaluate the performance of other transport protocols such as WebRTC and HTTP adaptive streaming. The outcome of the project will significantly improve the R&D activities for VM in InterDigital as well as contribute to Canada's VM industry competitive advantage, and globally, for the years to come. It also offers the exciting opportunity to train 5 HQP who will develop expertise in Networked Multimedia Systems and Immersive Media Technologies, which are competencies highly demanded in the job markets.
Program
Alliance Grants
Recipient
Location
Quebec, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
586434-2023
Name nom
Bentaleb, Abdelhak A
Department département
Computer Science and Software Engineering
Organization id
70
Institution établissement
Concordia University
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2024
Competition year année de concours
2023
Award amount
40000
Program id
ALLRP
Program name en
Alliance Grants
Program name fr
Subventions Alliance
Group en
RESEARCH PARTNERSHIPS
Group fr
PARTENARIATS DE RECHERCHE
Committee code
96
Committee name en
RPP Internal Decision Cttee
Committee name fr
Cté de décision interne - PPR
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
2721
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Multimedia systems and networks
Research subject fr
Systèmes et réseaux multimédias
Field of research list names en
Not available
Field of research list names fr
Non disponible
Socioeconomic objective list names en
Not available
Socioeconomic objective list names fr
Non disponible
Application title
An Intelligent End-to-End Immersive Media Transport Over QUIC-enabled 5G Networks
Keywords
applied ai in multimedia systems; extended reality and digital twin; immersive media processing; immersive media transport; media delivery optimization; mobile and wireless video streaming; networking and multimedia systems; network protocols and edge computing; next-generation networks; video quality adaptation
Application summary
Volumetric media (VM) such as volumetric video, mesh or point-cloud streaming technologies are the future of fully immersive VR/AR/XR experiences, which are becoming increasingly popular and are being used in a variety of applications (e.g., remote medicine, metaverse, and gaming). The challenges surrounding VM technologies are tremendous due to the high network bandwidth needed to produce high-quality and low-latency streams. Although, some studies have investigated aspects to mitigate these challenges, but mostly in isolation, and without considering holistically the end-to-end full transport workflow, especially in the context of a novel, mobile networks such as 5G. Designing an end-to-end VM transport with optimized quality of experience (QoE) is still a relatively new research topic and is challenging. This challenge is also confirmed by engineers from our industry partner, InterDigital, a pioneering R&D company in mobile/video technologies. The main goal of the proposed project is to explore and address key challenges in the transport of VM using QUIC, and to identify the best practices for using QUIC effectively in different scenarios, given the new network realities. In particular, we aim to address the following interrelated research tasks (T1-T6) holistically together: how to efficiently (T1) package, define and implement necessary QUIC-based (T2) payload formats and messages needed for signaling VM encoded using Volumetric Video-based Coding to allow (T3) flexible and robust quality adaptations and viewport predictions under extremely (T4) varying network conditions and with (T5) very low latency. We also aim to (T6) define and implement a mechanism on top of the proposed system to evaluate the performance of other transport protocols such as WebRTC and HTTP adaptive streaming. The outcome of the project will significantly improve the R&D activities for VM in InterDigital as well as contribute to Canada's VM industry competitive advantage, and globally, for the years to come. It also offers the exciting opportunity to train 5 HQP who will develop expertise in Networked Multimedia Systems and Immersive Media Technologies, which are competencies highly demanded in the job markets.
