Featured Publications

RF4XR
Radiance Fields in XR: A Survey on How Radiance Fields are Envisioned and Addressed for XR Research
2025 IEEE Transaction on Visualization and Computer Graphics (TVCG)
Paper/ Awesome RF4XR Repo/ Project Page
This survey paper aims to answer the following questions: i). how RF is envisioned for XR applications, (ii) how they have already been implemented, and (iii) the remaining research gaps through a systematic survey of radiance fields for XR of 365 papers.

I Hear, See, Speak & Do Demo
I Hear, See, Speak & Do: Bringing Multimodal Information Processing to Intelligent Virtual Agents for Natural Human-AI Communication
Ke Li*, Fariba Mostajeran*, Sebastian Rings, Lucie Kruse, Susanne Schmidt, Michael Arz, Erik Wolf, Frank Steinicke
2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW 2025)
Paper/ Code/ Video
This technical demo explores multimodal information processing techniques (e.g.facial expression, body actions) to enable intelligent virtual agents for natural human–AI communication in immersive extended reality environments.

MR Tunneling Demo
Reality Fusion: Robust Real-time Immersive Mobile Robot Teleoperation with Volumetric Visual Data Fusion
Ke Li, Reinhard Bacher, Susanne Schmidt, Wim Leemans, Frank Steinicke
2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2024, oral presentation)
Paper/ Code/ Video
A high performance and robust immersive robot teleoperation system that combines the best of both worlds: the high fidelity of neural rendering (3D Gaussian Splattings) and real-time stereoscopic point cloud projection.

MR Tunneling Demo
Magic NeRF Lens: Interactive Fusion of Neural Radiance Field for Virtual Facility Inspections
Frontiers in Virtual Reality
Ke Li, Susanne Schmidt, Tim Rolff, Reinhard Bacher, Wim Leemans, Frank Steinicke
Paper/ Code/ News / Video
Virtual inspection and maintenance of particle accelerators by combining CAD models and NeRF models through different magic lens effects.

MR Tunneling Demo
Mixed Reality Tunneling Effects for Stereoscopic Untethered Video-See-Through Head-Mounted Displays
Ke Li, Susanne Schmidt, Reinhard Bacher, Wim Leemans, Frank Steinicke
2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)
Paper / Code / Video
A novel sensor fusion technique that merges VST streams with various latency and resolution and leverages human's perceptual characteristics.
MR Tunneling Demo
Stereoscopic Video See-Through Head-Mounted Displays for Laser Safety: An Empirical Evaluation at Advanced Optics Laboratories
Ke Li, Aradhana Choudhuri, Susanne Schmidt, Tino Lang, Ingmar Hartl, Wim Leemans, Frank Steinicke
2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)
Paper / Video
The first work of using a stereoscopic VST-HMD as laser safety goggles with evaluation by 14 laser experts at DESY.