Skip to content
← All builds

Guide · updated 2026-10-20

Robots you can build with AI

'Vibe robotics' means letting an AI agent do the setup and even the control. Every project below is open source, and each card on Robot Use Cases includes a prompt you can paste into Claude Code, Cursor or Codex to install it.

Talk to it: AI voice desk robots

Cheap ESP32 boards plus a local or cloud LLM give you a desk robot you talk to. JARVIS Desk Bot speaks progress updates while your agent works. XiaoZhi and Stack-chan are the most popular firmware bases. Reachy Mini is the polished option.

Give your Hermes Agent a body

Hermes Gadget turns an ESP32-S3 board or a Raspberry Pi into a hold-to-talk voice terminal for your own Hermes Agent, and you can try it in a desktop simulator before you buy a board. Caduceus goes further: a foam-board ESP32 robot with four servos that Hermes moves through MCP tools. JARVIS Desk Bot, above, is the third option.

Let an agent drive a robot arm

Give a coding agent a tiny Python API for an SO-101 and it can draw, paint and check its own work on camera. Or train a vision-language-action model so the arm follows plain-English tasks. AIfred adds a projector so ChatGPT's help lands right on your desk.

Connect any ROS robot to an LLM

ROS MCP Server and NASA JPL's ROSA let Claude, ChatGPT or Gemini inspect topics and send commands to existing ROS robots, with no changes to robot code.

Agents with hands: phones and homes

A $7 ESP32 lets a vision model tap and type on a real iPhone. Stretch AI and OK-Robot let you ask a mobile manipulator to fetch things around the house.

Common questions

Can Claude Code or Cursor really set up a robot?

Yes, for the software side: cloning repos, installing LeRobot or ROS packages, flashing ESP32 firmware and writing control scripts. Keep a human on the physical e-stop and approve before motors move.

What's the cheapest robot to control with an LLM?

An ESP32 voice board (tens of dollars) running XiaoZhi, or an SO-101 arm (about $122 in parts) with a small Python control API.

What to build next

Builds that share a board, robot or agent with this one.

More guides: How to set up Anki Vector with wire-pod (2026) · Give your AI agent a robot body · Codex and ChatGPT hardware projects people actually built · What can Reachy Mini do? Real projects and apps · Cheap ESP32 robot projects you can build · Best robot arm under $200 · SO-101 vs SO-100 · SO-101 parts list and cost · AI hardware for robot and agent builds