Research
Full Papers
Reality Fusion: Robust Real-time Immersive Mobile Robot Teleoperation with Volumetric Visual Data Fusion
2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2024, oral presentation) A high performance and robust immersive robot teleoperation system that combines the best of both worlds: the high fidelity of neural rendering (3D Gaussian Splattings) and real-time stereoscopic point cloud projection.
Magic NeRF Lens: Interactive Fusion of Neural Radiance Field for Virtual Facility Inspections
Frontiers in Virtual Reality Virtual inspection and maintenance of particle accelerators by combining CAD models and NeRF models through different magic lens effects.
VRS-NeRF:Accelerating Neural Radiance Field Rendering with Variable Rate Shading
Lightning-fast VR-NeRF rendering with variable rate shading (VRS) utilizing characteristics of human vision (e.g. visual saliency, gaze, edges).
Mixed Reality Tunneling Effects for Stereoscopic Untethered Video-See-Through Head-Mounted Displays
2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) A novel sensor fusion technique that merges VST streams with various latency and resolution and leverages human's perceptual characteristics.
Stereoscopic Video See-Through Head-Mounted Displays for Laser Safety: An Empirical Evaluation at Advanced Optics Laboratories
2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) The first work of using a stereoscopic VST-HMD as laser safety goggles with evaluation by 14 laser experts at DESY.
Single Shot Phase Shift 3D Scanning with Convolutional Neural Network and Synthetic Fractals
2022 Eurographics Symposium on 3D Object Retrieval / Paper My master thesis work at the Fraunhofer IOF.
Demo, Poster, and Workshop Contributions
RealityGit: Cross Reality Version Control of R&D Optical Workbench
Honorable Mention for Best Design at ISMAR 2023 Student Competition
Exploring ideas of using NeRF to support multi-user collaborations across the spatial-temporal realities.
Immersive Neural Graphics Primitives
*Equal contributions.
IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR) 2023
The first open-source VR NERF Unity package that brings high resolution, low-latency, 6-DOF NeRF rendering to VR based on Nvidia's instant-ngp.
Taming Cyclops: Mixed Reality Head-Mounted Displays as Laser Safety Goggles for Advanced Optics Laboratories
IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR) / Poster A novel application of using mixed reality for eye protection for high power laser laboratories.
Towards Robust Exocentric Mobile Robot Tele-Operation in Mixed Reality
5th International Workshop on Virtual, Augmented, and Mixed Reality for HRI. (VAM-HRI)