WATonomous - Robotic Arm
Developed an end-to-end Imitation Learning (IL) pipeline and camera-based teleoperation for a humanoid robot arm.
- Imitation Learning: End-to-end IL pipeline on a simulated Franka Panda arm in IsaacLab; Differential IK teleoperation with keyboard control, 3×640×480 RGB capture, and GUI-triggered episode recording; exported robomimic-compatible HDF5 demos and trained policy using NVIDIA Isaac GR00T.
- Camera Teleoperation: Real-time MediaPipe hand-tracking for a 21-DOF arm; DexRetargeting IK with spherical wrist decomposition; 7-frame median + EMA + jerk-limiter pipeline for stable low-latency 3D control from 2D coordinates; 3-camera sync recording saving HDF5+MP4 for GR00T fine-tuning.
PythonIsaacLabIsaac GR00TPyTorchDexRetargetingOpenCVHDF5ROS2Imitation Learning




