Tell Stretch 3 to pick up objects around your home

Wheeled, Hard

Stretch AI from Hello Robot adds grasping, mapping, navigation and LLM agents to the Stretch 3 mobile manipulator, so you can say 'pick up the toy and put it in the basket'.

View build on GitHub ↗Share on X

It combines open-vocabulary perception, semantic maps and a planner, and runs on a GPU desktop talking to the robot.

Hardware & cost: A Hello Robot Stretch 3 plus a GPU workstation.

Difficulty: Hard.

Agent install prompt (paste into Claude Code, Cursor or Codex): "Install https://github.com/hello-robot/stretch_ai per the README on my GPU machine, connect to my Stretch, and run the pick-and-place demo."

Source: hello-robot/stretch_ai on GitHub — https://github.com/hello-robot/stretch_ai (facts checked against the project README, Oct 2026; prices vary by region).

Quick answers

What do you need to tell Stretch 3 to pick up objects around your home?: A Hello Robot Stretch 3 plus a GPU workstation.
How hard is it to tell Stretch 3 to pick up objects around your home?: Hard.

How your agent drives it

Copied from the hello-robot/stretch_ai README

Shell

$ ./scripts/run_stretch_ai_ros2_bridge_server.sh

Shell

$ python -m stretch.app.ai_pickup --use_llm --use_voice

Any coding agent that can run a shell can run these. Read the README before you run anything on a robot that moves.

Ideas to try with it

Our ideas, not the builder's claims.

Say 'pick up the toy and put it in the basket' and let it plan the route
Clear stray socks off the floor before a vacuum run
Fetch a remote from the couch to the coffee table

1 more idea

Map the apartment once and reuse the map for every task

Source: hello-robot/stretch_ai on GitHub
Last commit: 2026-07-02
Builder: hello-robot
Repo: hello-robot/stretch_ai, 251 stars
Built with: Hello Robot Stretch

Guides: Robots you can build with AI

What to build next

Builds that share a board, robot or agent with this one.