XR Virtual-real Fusion
Overview
XR (Extended Reality), integrating Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR), is rapidly becoming a key technology bridging the digital and physical worlds. Through immersive interaction and real-time computing capabilities, XR has been widely applied in education and training, audiovisual performances, cultural tourism, retail exhibitions, and medical assistance, effectively enhancing understanding efficiency and experiential value. With the maturation of real-time rendering, AI-generated content (AIGC), spatial computing, and multi-user collaboration technologies, XR is transforming from a demonstration tool into a scalable application platform. Our institute focuses on the research and development of core XR technologies and the integration of cross-domain applications, from early LBS AR and image and spatial understanding AR to metaverse and AI-driven XR content generation, striving to create immersive XR solutions with practicality, scalability, and innovative value.XR Virtual-real Fusion
CORE TECHNOLOGY
- Spatial computing and environmental understanding technology
- Avatar generation and simulation technology
- Virtual space modeling and rendering technology
- XR immersive scenario generation technology
- Cross-device multi-user synchronization and interaction technology
- LIVE holographic audio-visual performance technology
- Virtual-Real Integration Engineering Technology
XR Virtual-real Fusion
XR Virtual-real Fusion
Application Status
- In 2025, we held the "Exploring the Virtual and Real Universes" tax education and promotion event with the Southern Taiwan National Taxation Bureau of the Ministry of Finance. In conjunction with the Ming Hwa Yuan Drama Troupe, we used online virtual universe experiences and offline physical theater activities to allow the public to access emerging technologies and improve their understanding of tax education.
- In 2025, in collaboration with the Jane Goodall International Association, we utilized 3D Metaverse live streaming technology to recreate the speeches of 18 representative animals from the "United Nations of Animals" and Dr. Jane Goodall's core initiatives on the CHTLand platform, allowing the public to gain a deeper understanding of the importance of biodiversity and sustainability issues through a virtual immersive experience.
- In 2024, we will partner with the Tainan City Government to create the world's first "Metaverse Marathon," an event combining traditional running with innovative technology. This allows runners to not only sweat it out on a physical course but also experience Tainan's cultural heritage and sporting passion through the virtual world of Metaverse.
- In 2024, we will collaborate with the renowned Taiwanese traditional opera troupe, Ming Hwa Yuan Opera Troupe, to present Taiwan's first "Metaverse Double Classics" Taiwanese opera, broadcasting "Han Xiangzi" and "The Record of the Underworld War" within Metaverse. This innovative combination of technology and traditional opera creates a new milestone in cultural arts.
- In 2023, the "5G Metaverse Technology-Driven Urban Marketing Service Innovation Development Project" successfully applied for a grant from the National Development Council, and officially held its first event – the Yanshui Beehive Fireworks live stream – on February 24, 2024, the Lantern Festival. Simultaneously, in conjunction with the 400th anniversary of Tainan's founding, a 3D digital archive and guided tour were presented within the Metaverse, including historical sites such as Tainan Anping Ancient Fort, Anping Old Street, and Chihkan Tower.
- Utilize WebAR technology to provide AR experiences for users without requiring the installation of an app, and apply it to exhibition venues, including the "Asia Bay Innovation X New Startups in Southern China" exhibition at the Kaohsiung Exhibition Center in 2021, the "AR Interactive Experience" at the Taipei Smart City Exhibition in 2022, the "NCC 5G Vertical Field Experience" at the Kaohsiung Music Center, the Matsu project of the Ministry of Digital Development in 2023, and the application project at the Tainan Salt Mountain Salt Industry Exhibition, etc.
- In 2024, a Taiwan–Japan cross-border “VOD Holographic Performance” was successfully showcased at NTT R&D Forum 2024. The system supports multiple users simultaneously entering a virtual performance venue to experience 360° live-action performances, validating low-latency, high-bandwidth real-time transmission capabilities. In 2025, the “Live Holographic Performance” application was further completed, establishing a real-time holographic media system compliant with the MPEG Immersive Video (MIV) international standard. The system enables real-time voice and body interaction between audiences and performers, delivering a highly immersive and presence-rich viewing experience.
- A total of 37 patents have been applied for and granted by 2025.。