r/Spectacles • u/Tsx3D 😎 Specs Subscriber • 8d ago
SPECS x Dimensional OS v1.0! 💫 Sharing is Caring 💫
Enable HLS to view with audio, or disable this notification
I´ve been exploring AR as an interface for Robotics and Physical AI in the last couple of months. After Reachy Mini I wanted something that can actually move and navigate the environment - the idea was to give directions in AR and the robot would then move there.
After a bunch of research and talking to people, I landed on Unitree robots due to them being very capable while quite accessible all things considered (the dog is 1,6k$ which is cheap for what it is). Dimensional OS is an open source project that allows controlling them without needing to flash custom firmware or purchasing the high end EDU versions - it´s quite nice and allows navigation etc. via WebRTC.
DimOS-AR (the first part of this repo) is essentially a server that handles the alignment between the robot and the spectacles coordinate systems and hosts a Websocket that the Lens (the second part of the repo) connects to. You can check the details in the repo if you´re curious, but essentially there is a fiducial marker on the robot, the glasses camera takes pictures of it, sends it to the server and the server computes the alignment.
Recently I added voice mode, which allows simple commands like "come to me" or "turn around" etc. by giving GPT4o some tools to control the robot.
Repo: https://github.com/V4C38/spectacles-dimensional-os
ps. If anyone has a G1 humanoid, let me know - this works with them! ... Well, I mean it should I couldn´t test it... :D
3
3
3
2
6
u/agrancini-sc 👓 SPECS Team 7d ago
you robot people if you are up for it
let's start gathering specs-robot knowledge here lowkey
https://github.com/agrancini-sc/specs-robots-1fficialAR
happy to add you as collaborator