Grant: Engage Grants Program
École de technologie supérieure
$25,000.00
Performance evaluation of projection and compression in 3D 360 video
FY 2018-19
Summary
Omnidirectional (360) video applications are diverse and increasingly popular. They include immersive films,*live-streamed concerts, gaming, tourism, shopping and telepresence. Due to human peripheral vision being*limited to a small area of the 360 videos, and the area in view must be of sufficiently high-enough resolution, it*forces the capture of 360 videos at minimum of 4K or even 8K resolutions. Such high-resolution videos lead to*high computational complexity and huge data rates. These problems are aggravated with stereo (3D) 360*videos which are highly desirable to deliver a true immersive experience. Summit Tech offers 360 video*solutions and faces challenges with current streaming capabilities within networks constrained in delivering*optimal performance due to changing network conditions. It needs to assess which projections and encoders*can provide the best compression/ quality/ computational complexity trade-offs. Moreover, Summit Tech plans*to offer 3D 360 video solutions. Therefore, it needs to determine if the projections that are successful on 360*monoscopic video still perform well on 3D 360 videos. It must also determine if 3D codecs, which exploit the*disparity between views, can perform significantly better than the monoscopic ones on 3D content. The main*objective of this project is to develop software tools that permit to evaluate the performance of various 3D 360*components (e.g. projections and encoders) under various quality metrics. The projections will include*well-known projections as well as newer ones from the literature. The quality metrics will include PSNR-based*as well as novel panoramic and 3D objective quality metrics from the literature. The developed software will*be an extension of MPEG's JVET 360Lib supporting a wider range of projections, encoders and quality*metrics. The proposed software will also be reengineered to support the processing and performance evaluation*of 3D 360 videos which is currently lacking in 360Lib. This new software tool, the first supporting 3D 360*videos, will provide crucial information to orient the strategic technical directions and designs of new and*improved Summit Tech products and ensure their continuous world leadership and success.
Program
Engage Grants Program
Recipient
Location
Quebec, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
523516-2018
Name nom
Coulombe, Stéphane
Department département
Génie logiciel et des TI
Organization id
53
Institution établissement
École de technologie supérieure
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2018
Competition year année de concours
2018
Award amount
25000
Program id
EGP
Program name en
Engage Grants Program
Program name fr
Programme de subventions d'engagement partenariat
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
1552
Committee name en
Quebec Internal Decision Committee
Committee name fr
Comité de décision interne pour le Québec
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2708
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Image processing
Research subject fr
Traitement des images
Partie
1
Nb partie
1
Application title
Performance evaluation of projection and compression in 3D 360 video
Keyword
NSERC
Application summary
Omnidirectional (360) video applications are diverse and increasingly popular. They include immersive films,*live-streamed concerts, gaming, tourism, shopping and telepresence. Due to human peripheral vision being*limited to a small area of the 360 videos, and the area in view must be of sufficiently high-enough resolution, it*forces the capture of 360 videos at minimum of 4K or even 8K resolutions. Such high-resolution videos lead to*high computational complexity and huge data rates. These problems are aggravated with stereo (3D) 360*videos which are highly desirable to deliver a true immersive experience. Summit Tech offers 360 video*solutions and faces challenges with current streaming capabilities within networks constrained in delivering*optimal performance due to changing network conditions. It needs to assess which projections and encoders*can provide the best compression/ quality/ computational complexity trade-offs. Moreover, Summit Tech plans*to offer 3D 360 video solutions. Therefore, it needs to determine if the projections that are successful on 360*monoscopic video still perform well on 3D 360 videos. It must also determine if 3D codecs, which exploit the*disparity between views, can perform significantly better than the monoscopic ones on 3D content. The main*objective of this project is to develop software tools that permit to evaluate the performance of various 3D 360*components (e.g. projections and encoders) under various quality metrics. The projections will include*well-known projections as well as newer ones from the literature. The quality metrics will include PSNR-based*as well as novel panoramic and 3D objective quality metrics from the literature. The developed software will*be an extension of MPEG's JVET 360Lib supporting a wider range of projections, encoders and quality*metrics. The proposed software will also be reengineered to support the processing and performance evaluation*of 3D 360 videos which is currently lacking in 360Lib. This new software tool, the first supporting 3D 360*videos, will provide crucial information to orient the strategic technical directions and designs of new and*improved Summit Tech products and ensure their continuous world leadership and success.