Research
I Hear, See, Speak & Do: Bringing Multimodal Information Processing to Intelligent Virtual Agents for Natural Human-AI Communication
2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW 2025) This technical demo explores multimodal information processing techniques (e.g.facial expression, body actions) to enable intelligent virtual agents for natural human–AI communication in immersive extended reality environments.
A Toolkit for Creating Intelligent Virtual Humans in Extended Reality
2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) This workshop paper presents the entire technical stack of the Intelligent Virtual Human technology developed within the EU project PRESENCE , including virtul human creation, real-time action recognition, physics based animation, and speech and facial interactions.
Reality Fusion: Robust Real-time Immersive Mobile Robot Teleoperation with Volumetric Visual Data Fusion
2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2024, oral presentation) A high performance and robust immersive robot teleoperation system that combines the best of both worlds: the high fidelity of neural rendering (3D Gaussian Splattings) and real-time stereoscopic point cloud projection.
Magic NeRF Lens: Interactive Fusion of Neural Radiance Field for Virtual Facility Inspections
Frontiers in Virtual Reality Virtual inspection and maintenance of particle accelerators by combining CAD models and NeRF models through different magic lens effects.
VRS-NeRF:Accelerating Neural Radiance Field Rendering with Variable Rate Shading
Lightning-fast VR-NeRF rendering with variable rate shading (VRS) utilizing characteristics of human vision (e.g. visual saliency, gaze, edges).
RealityGit: Cross Reality Version Control of R&D Optical Workbench
Honorable Mention for Best Design at ISMAR 2023 Student Competition
Exploring ideas of using NeRF to support multi-user collaborations across the spatial-temporal realities.
Immersive Neural Graphics Primitives
*Equal contributions.
IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR) 2023
The first open-source VR NERF Unity package that brings high resolution, low-latency, 6-DOF NeRF rendering to VR based on Nvidia's instant-ngp.
Mixed Reality Tunneling Effects for Stereoscopic Untethered Video-See-Through Head-Mounted Displays
2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) A novel sensor fusion technique that merges VST streams with various latency and resolution and leverages human's perceptual characteristics.
Stereoscopic Video See-Through Head-Mounted Displays for Laser Safety: An Empirical Evaluation at Advanced Optics Laboratories
2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) The first work of using a stereoscopic VST-HMD as laser safety goggles with evaluation by 14 laser experts at DESY.
Taming Cyclops: Mixed Reality Head-Mounted Displays as Laser Safety Goggles for Advanced Optics Laboratories
2022 IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR) / Poster A novel application of using mixed reality for eye protection for high power laser laboratories.
Towards Robust Exocentric Mobile Robot Tele-Operation in Mixed Reality
5th International Workshop on Virtual, Augmented, and Mixed Reality for HRI. (VAM-HRI) 
Single Shot Phase Shift 3D Scanning with Convolutional Neural Network and Synthetic Fractals
2022 Eurographics Symposium on 3D Object Retrieval / Paper My master thesis work at the Fraunhofer IOF.