Skip to content

Candy Bar Sorting ​

This example demonstrates how to use Tzara, the Telekinesis Physical AI Agent, to build a candy bar sorting pipeline. Tzara generates code that scans a bin of mixed chocolate bars, classifies each one by color using a vision-language model, computes the grasping orientation from a PCA of the segmentation mask, and places each bar into the correct bin. Full Rerun visualization and detailed logging are included at every stage for debugging and traceability.

Demo ​

UR10e sorting chocolate bars by color into three separate bins

The Natural Language Instruction ​

In the bin there are 3 different types of chocolate, yellow, orange and brown. Can you sort them into 3 different bins. Do PCA on the mask for grasping orientation. Add detailed logging and Rerun visualization for every stage and step so we can see what is going on. The goal is robust debugging and traceability so failures can be diagnosed easily.

About this demonstration

This demonstration used an earlier SDK version. Breaking API changes have made the original code incompatible with the current SDK, so we have temporarily removed it. Updated code is coming soon.

Try It Yourself ​

Set up Tzara, open it in your configured workspace, and use the instructions above as a starting prompt. Review the generated code before running it.

For current APIs and examples, see Robot Motion.