Project Timeline and Contributions

Kim Tae-yeob joined the project in mid-August, significantly accelerating the development of VR-based teleoperation systems. His contributions include:

• Establishing Unity - VR - Mycobot connections
• Integrating Azure Kinect with Unity
• Working on BDSM-VR connections (ongoing)
• Managing the development personnel pool

Technical Achievements

• Successfully operating the Elephant Robotics Cobot 280 using Python
• Developing a digital twin of MyCobot using Unity and ROS
• Integrating Point Cloud technology with YOLO v8, ROS, and Unity
• Attempting to establish communication with BTS Manipulator

VR Teleoperation Architecture

A significant part of Kim’s work involves developing a VR teleoperation architecture using Unity and Mycobot 280 M5. The goal is to:

• Control Mycobot using Oculus Quest in Unity
• Replace Mycobot’s kinematic information with BDSM’s in Unity for simulation
• Send motion commands to the real BDSM controller for actual system operation