Guide · updated 2026-10-20
Robots you can build with AI
'Vibe robotics' means letting an AI agent do the setup and even the control. Every project below is open source, and each card on Robot Use Cases includes a prompt you can paste into Claude Code, Cursor or Codex to install it.
Talk to it: AI voice desk robots
Cheap ESP32 boards plus a local or cloud LLM give you a desk robot you talk to. JARVIS Desk Bot speaks progress updates while your agent works. XiaoZhi and Stack-chan are the most popular firmware bases. Reachy Mini is the polished option.
Give your Hermes Agent a body
Hermes Gadget turns an ESP32-S3 board or a Raspberry Pi into a hold-to-talk voice terminal for your own Hermes Agent, and you can try it in a desktop simulator before you buy a board. Caduceus goes further: a foam-board ESP32 robot with four servos that Hermes moves through MCP tools. JARVIS Desk Bot, above, is the third option.
Let an agent drive a robot arm
Give a coding agent a tiny Python API for an SO-101 and it can draw, paint and check its own work on camera. Or train a vision-language-action model so the arm follows plain-English tasks. AIfred adds a projector so ChatGPT's help lands right on your desk.
Connect any ROS robot to an LLM
ROS MCP Server and NASA JPL's ROSA let Claude, ChatGPT or Gemini inspect topics and send commands to existing ROS robots, with no changes to robot code.
Agents with hands: phones and homes
A $7 ESP32 lets a vision model tap and type on a real iPhone. Stretch AI and OK-Robot let you ask a mobile manipulator to fetch things around the house.
Common questions
Can Claude Code or Cursor really set up a robot?
Yes, for the software side: cloning repos, installing LeRobot or ROS packages, flashing ESP32 firmware and writing control scripts. Keep a human on the physical e-stop and approve before motors move.
What's the cheapest robot to control with an LLM?
An ESP32 voice board (tens of dollars) running XiaoZhi, or an SO-101 arm (about $122 in parts) with a small Python control API.
What to build next
Builds that share a board, robot or agent with this one.
Caduceus: a voice robot body for Hermes Agent, wired up over MCPAlso for Hermes Agent
Build an ESP32 AI voice robot with XiaoZhi and MCPAlso built on ESP32
JARVIS Desk Bot: a talking ESP32 desk robot for your AI agentAlso built on ESP32
Hermes Gadget: an ESP32 or Raspberry Pi voice body for your Hermes AgentAlso for Hermes Agent
El Tucu: a 4-servo robot arm that AI agents can rent by the minuteAlso built on ESP32
Control any ROS robot from Claude or ChatGPT with ROS MCP ServerAlso for MCP
More guides: How to set up Anki Vector with wire-pod (2026) · Give your AI agent a robot body · Codex and ChatGPT hardware projects people actually built · What can Reachy Mini do? Real projects and apps · Cheap ESP32 robot projects you can build · Best robot arm under $200 · SO-101 vs SO-100 · SO-101 parts list and cost · AI hardware for robot and agent builds