Steerable Multi-Robot Policies
Top 5 at the Actor Labs Act-athon. One language-steerable π0.7 policy driving two robots.
Built at the Actor Labs Act-athon with Gaurav Sethia and Siddharth Ghodasara, where the project placed in the top 5.
We fine-tuned Physical Intelligence’s π0.7 vision-language-action model into a single language-steerable policy that controls two very different robots working together: an SO-101 arm and a custom butter-passing robot. The same policy drives both embodiments, and natural language instructions steer what each robot does.
The butter-passing robot is my own design and build, inspired by the butter robot from Rick and Morty: a mobile base carrying two arms that move up and down, made to collaborate with the SO-101.