Research
2025
Radiance Fields in XR: A Survey on How Radiance Fields are Envisioned and Addressed for XR Research
2025 IEEE Transaction on Visualization and Computer Graphics (TVCG) (to appear at ISMAR 25) This survey paper aims to answer the following questions: i). how RF is envisioned for XR applications, (ii) how they have already been implemented, and (iii) the remaining research gaps through a systematic survey of radiance fields for XR of 365 papers.
A Conversational Virtual Agent with Physics-based Interactive Behaviour
2025 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) A technical demo showcasing the first embodied anthropomorphic intelligent virtual agent that can react to real-time physics-based events in standalone immersive VR experiences. (A collaboration with the [ARTANIM foundation](https://artanim.ch/))
I Hear, See, Speak & Do: Bringing Multimodal Information Processing to Intelligent Virtual Agents for Natural Human-AI Communication
2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW 2025) This technical demo explores multimodal information processing techniques (e.g.facial expression, body actions) to enable intelligent virtual agents for natural human–AI communication in immersive extended reality environments.
Effects of Verbal Interruption in Conversations with an Intelligent Virtual Agent in Virtual Reality
Conditionally accepted at ACM Symposium on Spatial User Interface (SUI) 2025 This is a student lead paper investigating the effects of granularity of being able to interrupt an intelligent virtual agent during a conversation in VR.
Nuance in Non-Verbal Communication: How Emotional Granularity Impacts Perception of Intelligent Virtual Agents in Virtual Reality
Universal Augmented Interaction Workshop (UNAI) at the IEEE International Symposium on Mixed and Augmented Reality (ISMAR) 2025 This is a student lead paper investigating the effects of granularity of IVA's emotional expression on user perception when interacting with IVA in VR.
A Toolkit for Creating Intelligent Virtual Humans in Extended Reality
2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) This workshop paper presents the entire technical stack of the Intelligent Virtual Human technology developed within the EU project PRESENCE , including virtul human creation, real-time action recognition, physics based animation, and speech and facial interactions.
2024
Towards a Particle Accelerator Metaverse: Mixed Reality Interfaces for Operations of Complex Physics Facilities
As a first step towards a particle accelerator metaverse, this dissertation explored how MR can be used to improve workflows for users working in extreme, complex, and hazardous conditions such as high-energy laser facilities and particle accelerator tunnels while contributing to the advancement of MR technology in general.
Reality Fusion: Robust Real-time Immersive Mobile Robot Teleoperation with Volumetric Visual Data Fusion
2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2024, oral presentation) A high performance and robust immersive robot teleoperation system that combines the best of both worlds: the high fidelity of neural rendering (3D Gaussian Splattings) and real-time stereoscopic point cloud projection.
Magic NeRF Lens: Interactive Fusion of Neural Radiance Field for Virtual Facility Inspections
Frontiers in Virtual Reality Virtual inspection and maintenance of particle accelerators by combining CAD models and NeRF models through different magic lens effects.
2023
VRS-NeRF:Accelerating Neural Radiance Field Rendering with Variable Rate Shading
Lightning-fast VR-NeRF rendering with variable rate shading (VRS) utilizing characteristics of human vision (e.g. visual saliency, gaze, edges).
RealityGit: Cross Reality Version Control of R&D Optical Workbench
Honorable Mention for Best Design at ISMAR 2023 Student Competition
Exploring ideas of using NeRF to support multi-user collaborations across the spatial-temporal realities.
Immersive Neural Graphics Primitives
*Equal contributions.
IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR) 2023
The first open-source VR NERF Unity package that brings high resolution, low-latency, 6-DOF NeRF rendering to VR based on Nvidia's instant-ngp.
2022
Mixed Reality Tunneling Effects for Stereoscopic Untethered Video-See-Through Head-Mounted Displays
2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) A novel sensor fusion technique that merges VST streams with various latency and resolution and leverages human's perceptual characteristics.
Stereoscopic Video See-Through Head-Mounted Displays for Laser Safety: An Empirical Evaluation at Advanced Optics Laboratories
2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) The first work of using a stereoscopic VST-HMD as laser safety goggles with evaluation by 14 laser experts at DESY.
Taming Cyclops: Mixed Reality Head-Mounted Displays as Laser Safety Goggles for Advanced Optics Laboratories
2022 IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR) / Poster A novel application of using mixed reality for eye protection for high power laser laboratories.
Towards Robust Exocentric Mobile Robot Tele-Operation in Mixed Reality
5th International Workshop on Virtual, Augmented, and Mixed Reality for HRI. (VAM-HRI) 
Single Shot Phase Shift 3D Scanning with Convolutional Neural Network and Synthetic Fractals
2022 Eurographics Symposium on 3D Object Retrieval / Paper My master thesis work at the Fraunhofer IOF.