Developing immersive virtual environments for intuitive robot control

This research focuses on developing an intuitive VR-based teleoperation system utilizing hand-tracking technology for efficient remote robot control. The study integrates advanced VR techniques with a master-slave robot system to address limitations in traditional telemanipulation, such as spatial perception and limited control precision.
The key innovation lies in replacing conventional handheld controllers with direct hand-tracking inputs. This allows operators to use their virtual hands, precisely replicating real-world movements in a virtual environment. The system also introduces a URDF-free robot importing method for seamless integration of robotic models into the VR platform.
In confined environments like hot cells, the system reconstructs and visualizes the workspace using RGB-D cameras, providing 3D visual feedback. This improves task efficiency and reduces operator fatigue by minimizing depth ambiguity.