HYPER-REALISTIC VIDEO
Overview
With the popularity of 5G and FTTH (Fiber To The Home) networks, the traditional single-view video live broadcast service gradually can no longer satisfy the appetite of viewers. The live broadcast service have moved towards UHD (Ultra High Definition) multi-view, wide-view, free-view video, and holography live streaming. Goldman Sachs Group predicts the size of the global live broadcast market will reach 4.1 billion US dollars by 2025. Combined with 5G network, our hyper-realistic video technology and applications can provide remote viewers watching multi-view live video through their own mobile terminal devices. This service can offer remote users a super immersive viewing experience as if they are in the front row of a ball game or concert venue.HYPER-REALISTIC VIDEO
CORE TECHNOLOGY
- Low-Latency Audio and Video Codec and Transmission Technology
- Multi-Camera Collaborative Operation Technology
- Ultra-Wide-View Video Processing and Transmission Technology
- Free-View Video Technology (4D Model/MPEG Immersive Video)
- Holography Technology
HYPER-REALISTIC VIDEO APPLICATIONS
HYPER-REALISTIC VIDEO
Application Status
Low-Latency, Multi-View Video Processing Technologies, and Applications:Combined with the large bandwidth and low-latency features of 5G and multi-access edge computing (MEC), it provides live audiences with self-owned mobile terminals to simultaneously watch multi-view, high-quality, delay-free live video. The technology has the characteristics of being able to real-time playback missed shots at any time point they need.
Our research results have been successfully applied to the 2020 KKBOX Billboard performance, Multi-view live broadcast of Lotte professional baseball game in Taoyuan Qingpu Stadium, live broadcasting 2020 WirHouse Gaming activities, etc.
Multi-Camera Collaboration and UHD Ultra-Wide Video Processing Technologies and Applications: Limited by the usage of 16K UHD ultra-high-definition video shooting cameras and display equipment is still not popularized yet. CHT-TL has developed a 12K UHD ultra-wide live broadcast service by real-time stitching multiple 4K camera images into a 11520*2160 resolution image. Hence, the stitched video can be transmitted through internet and remotely projected to a large screen (e.g., 500-1000 inches) to provide audiences with a super-realistic viewing experience.
Free-View Video Technology: Multiple cameras are set up in a ring to shoot the same target. Users can watch freely switch the video angle they want to watch (such as the bullet time of the hacker mission) through mobile devices, personal computers, and web browsers to provide a personalized viewing experience. An image interpolation approach with AI technology result has been published (AIPE 2024, [FUN-VFI: Flow-Upscaling Network for 4K Video Frame Interpolation], which won the Best Presentation Award). The technology can rapidly generate a virtual viewpoint image between two physical cameras to expand video content. The research and development results can be applied to a variety of performance activities, such as sports events, dance performances, fitness coaching, etc.
Holography Technology: Multiple users can join a virtual exhibition hall and freely move around, watch 720-degree 4D model videos and interact (body and voice) through mobile devices, personal computers, or VR headsets to provide a highly immersive viewing experience. Developed a holographic video production and streaming system compliant with the MPEG Immersive Video international standards, aiming to collaborate with global media providers to expand service in the future. The research and development results have been demonstrated at the NTT R&D Forum 2024 in a Taiwan-Japan cross-border holographic demonstration, presenting the network characteristics of low latency and high bandwidth .
A total of 10 patents have been applied for and certified by 2024.