Skip to content
← All builds
JARVIS desk bot with glowing eyes on a desk
JARVIS desk bot with glowing eyes on a deskCredit: dreamhunter02/jarvis-desk-bot
JARVIS desk bot with glowing eyes on a desk (image 2)
JARVIS desk bot with glowing eyes on a desk (image 3)

JARVIS Desk Bot: a talking ESP32 desk robot for your AI agent

Desk, MediumWorks with Hermes Agent

An open-source voice front end for the Hermes agent: say 'Jarvis', ask for something, and a small ESP32-S3 desk robot talks back with progress updates while the agent works, handing long jobs to background helpers.

JARVIS Desk Bot chains an ESP32-S3 desk robot to xiaozhi-esp32-server (local Parakeet speech recognition and Kokoro text-to-speech) to any Hermes agent. It plays a wake chime, shows 'thinking' eyes, speaks short status lines so there's no dead air, and reports back when a background helper finishes. Demos include Google Tasks. It went viral on X this week (via @witcheer and the maker @vineethkalluru).

Hardware & cost: An ESP32-S3 desk robot running Espressif's ESP-Brookesia chatbot example with the xiaozhi agent (release/v0.7, ESP-IDF 5.5), a machine for the voice server, and a Hermes agent. ESP32-S3 voice boards typically cost tens of dollars. MIT licensed.

Difficulty: Medium. Flashing ESP-IDF firmware and running a local speech server.

Agent install prompt (paste into Claude Code, Cursor or Codex): "Clone https://github.com/dreamhunter02/jarvis-desk-bot. Follow its README: set up xiaozhi-esp32-server with Parakeet ASR and Kokoro TTS, run the repo's apply.py installer to add the Hermes provider and chimes, flash my ESP32-S3 robot with the ESP-Brookesia chatbot example, and point it at my server. Ask before flashing."

Seen on X: https://x.com/witcheer/status/2111028813555523855 and the launch post https://x.com/vineethkalluru/status/2108388089731436546

Source: dreamhunter02/jarvis-desk-bot on GitHub — https://github.com/dreamhunter02/jarvis-desk-bot (facts checked against the project README, Oct 2026; prices vary by region).

Quick answers

What do you need to build JARVIS Desk Bot?
An ESP32-S3 desk robot running Espressif's ESP-Brookesia chatbot example with the xiaozhi agent (release/v0.7, ESP-IDF 5.5), a machine for the voice server, and a Hermes agent. ESP32-S3 voice boards typically cost tens of dollars. MIT licensed.
How hard is JARVIS Desk Bot to build?
Medium. Flashing ESP-IDF firmware and running a local speech server.

How your agent drives it

Copied from the dreamhunter02/jarvis-desk-bot README

  1. Shell
    $ git clone https://github.com/dreamhunter02/jarvis-desk-bot.git
  2. Shell
    $ cp hermes/SOUL.md ~/.hermes/SOUL.md
  3. Shell
    $ python xiaozhi/apply.py ~/xiaozhi-server/main/xiaozhi-server

Any coding agent that can run a shell can run these. Read the README before you run anything on a robot that moves.

Ideas to try with it

Our ideas, not the builder's claims.

  1. Say 'Jarvis, add milk to my list' and hear it confirm
  2. Ask it to research something and get spoken progress while it works
  3. Hand long jobs to background helpers and get pinged when they finish
1 more idea
  1. Read out your next three Google Tasks every morning
Source
dreamhunter02/jarvis-desk-bot on GitHub
Last commit
2026-10-09
Builder
dreamhunter02
Repo
dreamhunter02/jarvis-desk-bot, 26 stars
Built with
ESP32, Hermes Agent

Guides: How to set up Anki Vector with wire-pod (2026) · Give your AI agent a robot body · Codex and ChatGPT hardware projects people actually built · Cheap ESP32 robot projects you can build · Robots you can build with AI · AI hardware for robot and agent builds

What to build next

Builds that share a board, robot or agent with this one.