


JARVIS Desk Bot: a talking ESP32 desk robot for your AI agent
Desk, MediumWorks with Hermes Agent
An open-source voice front end for the Hermes agent: say 'Jarvis', ask for something, and a small ESP32-S3 desk robot talks back with progress updates while the agent works, handing long jobs to background helpers.
JARVIS Desk Bot chains an ESP32-S3 desk robot to xiaozhi-esp32-server (local Parakeet speech recognition and Kokoro text-to-speech) to any Hermes agent. It plays a wake chime, shows 'thinking' eyes, speaks short status lines so there's no dead air, and reports back when a background helper finishes. Demos include Google Tasks. It went viral on X this week (via @witcheer and the maker @vineethkalluru).
Hardware & cost: An ESP32-S3 desk robot running Espressif's ESP-Brookesia chatbot example with the xiaozhi agent (release/v0.7, ESP-IDF 5.5), a machine for the voice server, and a Hermes agent. ESP32-S3 voice boards typically cost tens of dollars. MIT licensed.
Difficulty: Medium. Flashing ESP-IDF firmware and running a local speech server.
Agent install prompt (paste into Claude Code, Cursor or Codex): "Clone https://github.com/dreamhunter02/jarvis-desk-bot. Follow its README: set up xiaozhi-esp32-server with Parakeet ASR and Kokoro TTS, run the repo's apply.py installer to add the Hermes provider and chimes, flash my ESP32-S3 robot with the ESP-Brookesia chatbot example, and point it at my server. Ask before flashing."
Seen on X: https://x.com/witcheer/status/2111028813555523855 and the launch post https://x.com/vineethkalluru/status/2108388089731436546
Source: dreamhunter02/jarvis-desk-bot on GitHub — https://github.com/dreamhunter02/jarvis-desk-bot (facts checked against the project README, Oct 2026; prices vary by region).
Quick answers
- What do you need to build JARVIS Desk Bot?
- An ESP32-S3 desk robot running Espressif's ESP-Brookesia chatbot example with the xiaozhi agent (release/v0.7, ESP-IDF 5.5), a machine for the voice server, and a Hermes agent. ESP32-S3 voice boards typically cost tens of dollars. MIT licensed.
- How hard is JARVIS Desk Bot to build?
- Medium. Flashing ESP-IDF firmware and running a local speech server.
How your agent drives it
Copied from the dreamhunter02/jarvis-desk-bot README
- Shell
$ git clone https://github.com/dreamhunter02/jarvis-desk-bot.git
- Shell
$ cp hermes/SOUL.md ~/.hermes/SOUL.md
- Shell
$ python xiaozhi/apply.py ~/xiaozhi-server/main/xiaozhi-server
Any coding agent that can run a shell can run these. Read the README before you run anything on a robot that moves.
Ideas to try with it
Our ideas, not the builder's claims.
- Say 'Jarvis, add milk to my list' and hear it confirm
- Ask it to research something and get spoken progress while it works
- Hand long jobs to background helpers and get pinged when they finish
1 more ideaShow fewer
- Read out your next three Google Tasks every morning
- Last commit
- 2026-10-09
- Builder
- dreamhunter02
- Repo
- dreamhunter02/jarvis-desk-bot, 26 stars
- Built with
- ESP32, Hermes Agent
Guides: How to set up Anki Vector with wire-pod (2026) · Give your AI agent a robot body · Codex and ChatGPT hardware projects people actually built · Cheap ESP32 robot projects you can build · Robots you can build with AI · AI hardware for robot and agent builds
What to build next
Builds that share a board, robot or agent with this one.
Hermes Gadget: an ESP32 or Raspberry Pi voice body for your Hermes AgentAlso for Hermes Agent
Caduceus: a voice robot body for Hermes Agent, wired up over MCPAlso for Hermes Agent
Build an ESP32 AI voice robot with XiaoZhi and MCPAlso built on ESP32
Make Stack-chan, the cute M5Stack desk robotAlso built on ESP32
Reflect: a voice-and-light assistant on an M5Stack CoreS3Also built on ESP32- Talk to the OpenAI Realtime API from an ESP32 over WebRTCAlso built on ESP32