Vuer

A Python-driven 3D visualization framework that runs inside a VR headset's browser.

Vuer is an open-source Python 3D visualization framework by Ge Yang, built on web technology and supporting WebXR (the browser standard for accessing VR/AR devices). After starting a server on the Python side, headsets such as the Apple Vision Pro or Meta Quest can enter the 3D scene just by opening a page in their browser, with no native app needed. It can stream the rendered view to the headset while simultaneously streaming head- and hand-keypoint poses back to Python in real time — exactly the two-way channel teleoperation needs, which is why projects such as Open-TeleVision and Unitree's xr_teleoperate use it as their VR teleoperation front end.

ExampleOpen-TeleVision uses Vuer to display a robot's stereo head-camera feed inside the Vision Pro, while reading the operator's hand keypoints and retargeting them into arm and dexterous-hand motions for a humanoid robot.

Related

Open-TeleVision · VR Teleoperation · Apple Vision Pro · Unitree xr_teleoperate · Viser · Web Real-Time Communication (WebRTC)

Sources

vuer-ai/vuer GitHub
Vuer documentation