Research

Full Papers

MR Tunneling Demo
Reality Fusion: Robust Immersive Robot Teleoperation at Complex Semi-structured Environment
Ke Li, Reinhard Bacher, Susanne Schmidt, Wim Leemans, Frank Steinicke
Code & Paper coming soon..
A high performance and robust immersive robot teleoperation system that combines the best of both worlds: the high fidelity of neural rendering (3D Gaussian Splattings) and real-time stereoscopic point cloud projection.

MR Tunneling Demo
Magic NeRF Lens: Interactive Fusion of Neural Radiance Field for Virtual Facility Inspections
Ke Li, Susanne Schmidt, Tim Rolff, Reinhard Bacher, Wim Leemans, Frank Steinicke
Arxiv/ Code/ News / (Accepted/ To appear at Frontiers VR)
Virtual inspection and maintenance of particle accelerators by combining CAD models and NeRF models through different magic lens effects.

MR Tunneling Demo
VRS-NeRF:Accelerating Neural Radiance Field Rendering with Variable Rate Shading
Tim Rolff, Susanne Schmidt, Ke Li, Frank Steinicke, Simone Frintrop
2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)
Paper
Lightning-fast VR-NeRF rendering with variable rate shading (VRS) utilizing characteristics of human vision (e.g. visual saliency, gaze, edges).

MR Tunneling Demo
Mixed Reality Tunneling Effects for Stereoscopic Untethered Video-See-Through Head-Mounted Displays
Ke Li, Susanne Schmidt, Reinhard Bacher, Wim Leemans, Frank Steinicke
2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)
Paper / Code
A novel sensor fusion technique that merges VST streams with various latency and resolution and leverages human's perceptual characteristics.
MR Tunneling Demo
Stereoscopic Video See-Through Head-Mounted Displays for Laser Safety: An Empirical Evaluation at Advanced Optics Laboratories
Ke Li, Aradhana Choudhuri, Susanne Schmidt, Tino Lang, Ingmar Hartl, Wim Leemans, Frank Steinicke
2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)
Paper
The first work of using a stereoscopic VST-HMD as laser safety goggles with evaluation by 14 laser experts at DESY.
MR Tunneling Demo
Single Shot Phase Shift 3D Scanning with Convolutional Neural Network and Synthetic Fractals
Ke Li, Spehr, Marcel, Höhne, Daniel, Bräuer-Burchardt, Christian, Tünnermann, Andreas , Kühmstedt, Peter
2022 Eurographics Symposium on 3D Object Retrieval / Paper
My master thesis work at the Fraunhofer IOF.

Demo, Poster, and Workshop Contributions

MR Tunneling Demo
RealityGit: Cross Reality Version Control of R&D Optical Workbench
Ke Li, Tim Rolff, Reinhard Bacher, Frank Steinicke
Honorable Mention for Best Design at ISMAR 2023 Student Competition
Video Demo / Paper
Exploring ideas of using NeRF to support multi-user collaborations across the spatial-temporal realities.

MR Tunneling Demo
Immersive Neural Graphics Primitives
Ke Li*, Tim Rolff*, Susanne Schmidt, Reinhard Bacher, Simone Frintrop, Wim Leemans, Frank Steinicke
*Equal contributions.
IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR) 2023
arxiv / Code
The first open-source VR NERF Unity package that brings high resolution, low-latency, 6-DOF NeRF rendering to VR based on Nvidia's instant-ngp.

MR Tunneling Demo
Taming Cyclops: Mixed Reality Head-Mounted Displays as Laser Safety Goggles for Advanced Optics Laboratories
Ke Li, Aradhana Choudhuri, Susanne Schmidt, Ingmar Hartl, Wim Leemans, Frank Steinicke
IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR) / Poster
A novel application of using mixed reality for eye protection for high power laser laboratories.
cozmo demo
Towards Robust Exocentric Mobile Robot Tele-Operation in Mixed Reality
Ke Li, Reinhard Bacher, Wim Leemans, Frank Steinicke
5th International Workshop on Virtual, Augmented, and Mixed Reality for HRI. (VAM-HRI)
Paper / Project / Code