Mixed Bin Clearing
This example demonstrates how to use Tzara, the Telekinesis Physical AI Agent, to build a vision-guided bin clearing pipeline. Tzara generates code that moves to a scan pose, detects all objects in a bin using QWEN, segments each detection with SAM, and computes grasp orientation via PCA on the binary mask in image space. The 3D grasp position is back-projected from the depth image using camera intrinsics, and each object is picked at a fixed grasp height before being dropped into a target box.
Demo
UR10e picking mixed objects from a bin and dropping into a box
The Natural Language Instruction
Pick different objects from the blue bin and drop them into box. Scan pose is [-0.25462, 0.59302, 0.3141, 180.0, 0.0, 90.0], drop pose is [-0.740, 0.727, -0.2, -180.0, 0.0, 90.0]. Use Sam after qwen get the mask and do PCA on that in image space. Make the grasp height GRASP_Z = 0.015.About this demonstration
This demonstration used an earlier SDK version. Breaking API changes have made the original code incompatible with the current SDK, so we have temporarily removed it. Updated code is coming soon.
Try It Yourself
Set up Tzara, open it in your configured workspace, and use the instructions above as a starting prompt. Review the generated code before running it.
For current APIs and examples, see Robot Motion.