Skip to content

Telekinesis Skill Examples

Free Tier
Every new account starts on a free tier with credits to call the SDK — no billing details required.
Create API key →

Prerequisites

New here? Complete the Quickstart first — it sets up your API key, conda environment, and SDK in under 5 minutes.

Run an Example!

Run any example from telekinesis-examples repository

Clone the repository and the telekinesis-data submodule

bash
git clone --depth 1 --recurse-submodules --shallow-submodules \
  https://github.com/telekinesis-ai/telekinesis-examples.git

cd telekinesis-examples
What gets downloaded?

The flags above keep the clone small:

  • --depth 1 fetches only the latest commit, not full history.
  • --recurse-submodules --shallow-submodules also pulls the telekinesis-data submodule (sample images, point clouds, robot states), again at depth 1. Roughly 1.5 GB of free disk space is required for the telekinesis-data.

When you start using Telekinesis on your own data, you can ignore the telekinesis-data submodule - it exists purely to make the examples runnable out of the box.

Install dependencies for examples

bash
conda activate telekinesis
pip install rerun-sdk==0.31.2 pycocotools scipy

Run an example (see more examples below)

Runs segment_image_using_sam and visualizes masks in Rerun.

bash
python examples/cornea_examples.py --example segment_image_using_sam

SAM segmentation example: input image on the left, segmentation masks on the right

SAM masks predicted from the sample input image.

Cornea

List all available examples and run one:

bash
python examples/cornea_examples.py --list
bash
python examples/cornea_examples.py --example <name>
Segment Image Using RGB 0Segment Image Using RGB 1
Cornea

Segment Image Using RGB

Segments regions by thresholding raw RGB color channels.

View →
Segment Image Using HSV 0Segment Image Using HSV 1
Cornea

Segment Image Using HSV

Segments regions by thresholding hue, saturation, and value.

View →
Segment Image Using LAB 0Segment Image Using LAB 1
Cornea

Segment Image Using LAB

Segments regions using perceptually uniform LAB color space.

View →
Segment Image Using YCrCb 0Segment Image Using YCrCb 1
Cornea

Segment Image Using YCrCb

Segments regions by separating luminance from chroma components.

View →
Segment Image Using Focus Region 0Segment Image Using Focus Region 1
Cornea

Segment Image Using Focus Region

Isolates a rectangular region of interest for downstream processing.

View →
Segment Image Using Watershed 0Segment Image Using Watershed 1
Cornea

Segment Image Using Watershed

Segments touching or overlapping objects using the watershed algorithm.

View →
Segment Image Using Flood Fill 0Segment Image Using Flood Fill 1
Cornea

Segment Image Using Flood Fill

Segments a contiguous region by flood-filling from a seed point.

View →
Segment Image Using Foreground BiRefNet 0Segment Image Using Foreground BiRefNet 1
Cornea

Segment Image Using Foreground BiRefNet

Extracts foreground from background using the BiRefNet deep learning model.

View →
Segment Image Using SAM 0Segment Image Using SAM 1
Cornea

Segment Image Using SAM

Segments arbitrary objects using Meta's Segment Anything Model (SAM).

View →
Segment Image Using GrabCut 0Segment Image Using GrabCut 1
Cornea

Segment Image Using GrabCut

Separates foreground from background using the GrabCut graph-cut algorithm.

View →
Segment Image Using Felzenszwalb 0Segment Image Using Felzenszwalb 1
Cornea

Segment Image Using Felzenszwalb

Over-segments an image into superpixels using Felzenszwalb's method.

View →
Segment Image Using SLIC Superpixel 0Segment Image Using SLIC Superpixel 1
Cornea

Segment Image Using SLIC Superpixel

Groups pixels into compact superpixels using the SLIC algorithm.

View →
Filter Segments By Area 0Filter Segments By Area 1
Cornea

Filter Segments By Area

Removes segments outside a specified minimum or maximum area.

View →
Filter Segments By Color 0Filter Segments By Color 1
Cornea

Filter Segments By Color

Keeps only segments whose average color falls within a target range.

View →
Filter Segments By Mask 0Filter Segments By Mask 1
Cornea

Filter Segments By Mask

Filters segments based on overlap with a provided binary mask.

View →
Segment Image Using Otsu Threshold 0Segment Image Using Otsu Threshold 1
Cornea

Segment Image Using Otsu Threshold

Binarizes an image by automatically finding the optimal Otsu threshold.

View →
Segment Image Using Local Threshold 0Segment Image Using Local Threshold 1
Cornea

Segment Image Using Local Threshold

Applies adaptive thresholding over local image neighborhoods.

View →
Segment Image Using Yen Threshold 0Segment Image Using Yen Threshold 1
Cornea

Segment Image Using Yen Threshold

Binarizes an image using Yen's maximum correlation thresholding method.

View →
Segment Image Using Threshold 0Segment Image Using Threshold 1
Cornea

Segment Image Using Threshold

Segments an image using a fixed manually specified threshold value.

View →
Segment Image Using Adaptive Threshold 0Segment Image Using Adaptive Threshold 1
Cornea

Segment Image Using Adaptive Threshold

Computes per-pixel thresholds based on local mean or Gaussian-weighted neighborhood.

View →
Segment Image Using Laplacian Threshold 0Segment Image Using Laplacian Threshold 1
Cornea

Segment Image Using Laplacian Threshold

Detects and segments edges by thresholding the Laplacian of the image.

View →
bash
python examples/cornea_examples.py --example segment_image_using_rgb

Retina

List all available examples and run one:

bash
python examples/retina_examples.py --list
bash
python examples/retina_examples.py --example <name>
bash
python examples/retina_examples.py --example detect_contours

Pupil

List all available examples and run one:

bash
python examples/pupil_examples.py --list
bash
python examples/pupil_examples.py --example <name>
Bitwise AND Images 0Bitwise AND Images 1
Pupil

Bitwise AND Images

Perform a pixel-wise bitwise AND operation between two images or binary masks, useful for mask intersection and logical filtering.

View →
Bitwise Difference Images 0Bitwise Difference Images 1
Pupil

Bitwise Difference Images

Compute the pixel-wise absolute difference between two images to highlight changes, useful for motion detection, defect inspection, and image comparison.

View →
Bitwise NOT Image 0Bitwise NOT Image 1
Pupil

Bitwise NOT Image

Invert an image or binary mask by performing a pixel-wise bitwise NOT operation. Useful for mask inversion, foreground/background swapping, and logical complement operations.

View →
Bitwise OR Images 0Bitwise OR Images 1
Pupil

Bitwise OR Images

Combine two images or binary masks using pixel-wise bitwise OR operation. Useful for mask union, merging detection results, and filling gaps.

View →
Bitwise XOR Images 0Bitwise XOR Images 1
Pupil

Bitwise XOR Images

Compute pixel-wise exclusive regions between two binary images using bitwise XOR. Useful for change detection, mask comparison, and highlighting differences.

View →
Calculate Mask Centroid 0Calculate Mask Centroid 1
Pupil

Calculate Mask Centroid

Compute the centroid (center of mass) of non-zero pixels in a binary mask. Useful for object localization, alignment, and tracking.

View →
Calculate Mask PCA 0Calculate Mask PCA 1
Pupil

Calculate Mask PCA

Perform principal component analysis on a binary mask to compute centroid, eigenvectors, eigenvalues, and principal angle with visualization. Useful for shape orientation analysis, alignment, and morphological characterization.

View →
Convert Image Color Space 0Convert Image Color Space 1
Pupil

Convert Image Color Space

Convert an image between color spaces (e.g., RGB, BGR, HSV, GRAY, RGBA) for segmentation, display, or cross-library compatibility.

View →
Crop Image Center 0Crop Image Center 1
Pupil

Crop Image Center

Crop an image to specified dimensions centered on the image, with optional padding for smaller images. Useful for fixed-size model inputs, thumbnails, and normalization.

View →
Crop Image Using Bounding Boxes 0Crop Image Using Bounding Boxes 1
Pupil

Crop Image Using Bounding Boxes

Crop an image using multiple rectangular bounding boxes, optionally retaining coordinate metadata. Useful for object detection, ROI extraction, and batch processing.

View →
Crop Image Using Polygon 0Crop Image Using Polygon 1
Pupil

Crop Image Using Polygon

Crop an image using an arbitrary polygon mask, retaining pixels inside the polygon. Useful for irregular shapes, segmentation contours, and non-rectangular ROIs.

View →
Enhance Image Using Auto Gamma Correction 0Enhance Image Using Auto Gamma Correction 1
Pupil

Enhance Image Using Auto Gamma Correction

Automatically adjust image brightness using adaptive gamma estimation to normalize exposure. Ideal for varying lighting conditions.

View →
Enhance Image Using CLAHE 0Enhance Image Using CLAHE 1
Pupil

Enhance Image Using CLAHE

Apply Contrast Limited Adaptive Histogram Equalization (CLAHE) to enhance local contrast while controlling noise amplification, ideal for low-light or unevenly illuminated images.

View →
Enhance Image Using White Balance 0Enhance Image Using White Balance 1
Pupil

Enhance Image Using White Balance

Apply automatic white balance correction to remove color casts and adjust color temperature, ensuring neutral colors appear natural under varying illumination.

View →
Filter Image Using Bilateral 0Filter Image Using Bilateral 1
Pupil

Filter Image Using Bilateral

Apply a bilateral filter to reduce image noise while preserving edges by considering both spatial proximity and color similarity, ideal for edge-preserving smoothing in photography and vision pipelines.

View →
Filter Image Using Blur 0Filter Image Using Blur 1
Pupil

Filter Image Using Blur

Apply a simple box blur to quickly smooth an image by averaging pixel values within a kernel. Ideal for fast preprocessing, background estimation, or artistic blur effects where edge preservation is not critical.

View →
Filter Image Using Box 0Filter Image Using Box 1
Pupil

Filter Image Using Box

Apply a normalized box filter to perform basic averaging with control over kernel size, normalization, output depth, and border handling. Ideal for preprocessing, local averaging, and feature extraction where precision matters.

View →
Filter Image Using Frangi 0Filter Image Using Frangi 1
Pupil

Filter Image Using Frangi

Apply the Frangi vesselness filter to enhance tubular structures in images, ideal for medical imaging, retinal scans, angiography, and other applications requiring vessel detection.

View →
Filter Image Using Gabor 0Filter Image Using Gabor 1
Pupil

Filter Image Using Gabor

Apply a Gabor filter to detect oriented textures and features at specific scales and orientations, ideal for texture analysis, fingerprint recognition, and biomedical imaging.

View →
Filter Image Using Gaussian Blur 0Filter Image Using Gaussian Blur 1
Pupil

Filter Image Using Gaussian Blur

Apply a Gaussian blur to smoothly reduce noise while preserving edges, ideal for preprocessing, image enhancement, and feature extraction in computer vision pipelines.

View →
Filter Image Using Hessian Filter 0Filter Image Using Hessian Filter 1
Pupil

Filter Image Using Hessian Filter

Apply a Hessian-based vesselness filter to detect tubular and ridge-like structures, offering a faster alternative to Frangi for vessel detection and ridge enhancement in biomedical and industrial imaging.

View →
Filter Image Using Laplacian Filter 0Filter Image Using Laplacian Filter 1
Pupil

Filter Image Using Laplacian Filter

Apply a Laplacian filter to detect edges and fine details using second-order derivatives, ideal for precise edge localization, image sharpening, and zero-crossing detection.

View →
Filter Image Using Median Blur 0Filter Image Using Median Blur 1
Pupil

Filter Image Using Median Blur

Apply a median blur filter to remove salt-and-pepper noise while preserving edges, ideal for impulse noise removal and image restoration in vision pipelines.

View →
Filter Image Using Meijering 0Filter Image Using Meijering 1
Pupil

Filter Image Using Meijering

Apply the Meijering filter to detect neurites and fine branching structures in biomedical images, ideal for neuronal imaging and morphological analysis.

View →
Filter Image Using Morphological Blackhat 0Filter Image Using Morphological Blackhat 1
Pupil

Filter Image Using Morphological Blackhat

Apply morphological black-hat transform to extract small dark features, cracks, or holes on bright backgrounds, ideal for defect and surface inspection.

View →
Filter Image Using Morphological Close 0Filter Image Using Morphological Close 1
Pupil

Filter Image Using Morphological Close

Apply morphological closing (dilation followed by erosion) to fill holes and connect nearby objects while preserving overall shape, ideal for segmentation cleanup and feature completion.

View →
Filter Image Using Morphological Dilation 0Filter Image Using Morphological Dilation 1
Pupil

Filter Image Using Morphological Dilation

Apply morphological dilation to expand bright regions and fill small gaps or holes, useful for mask expansion, object connection, and feature enhancement.

View →
Filter Image Using Morphological Erosion 0Filter Image Using Morphological Erosion 1
Pupil

Filter Image Using Morphological Erosion

Apply morphological erosion to shrink bright regions and remove small noise, useful for binary image cleanup, object separation, and feature removal.

View →
Filter Image Using Morphological Gradient 0Filter Image Using Morphological Gradient 1
Pupil

Filter Image Using Morphological Gradient

Apply morphological gradient to extract object boundaries by computing the difference between dilation and erosion, useful for robust edge detection in binary or grayscale images.

View →
Filter Image Using Morphological Open 0Filter Image Using Morphological Open 1
Pupil

Filter Image Using Morphological Open

Apply morphological opening (erosion followed by dilation) to remove small noise while preserving object size, effective for binary image cleanup and segmentation refinement.

View →
Filter Image Using Morphological Tophat Filter 0Filter Image Using Morphological Tophat Filter 1
Pupil

Filter Image Using Morphological Tophat Filter

Apply morphological top-hat transform to extract or enhance small bright features in images, useful for background correction, small object detection, and detail enhancement.

View →
Filter Image Using Sato Filter 0Filter Image Using Sato Filter 1
Pupil

Filter Image Using Sato Filter

Apply Sato filter for multi-scale ridge detection to enhance thin linear structures such as fibers, vessels, cracks, and PCB traces.

View →
Filter Image Using Scharr 0Filter Image Using Scharr 1
Pupil

Filter Image Using Scharr

Apply Scharr filter for high-accuracy edge detection with improved rotation invariance, suitable for gradient-based applications.

View →
Filter Image Using Sobel 0Filter Image Using Sobel 1
Pupil

Filter Image Using Sobel

Apply Sobel filter for directional edge detection, computing gradients in X and Y directions to detect edges and orientation.

View →
Merge Image From Channels 0Merge Image From Channels 1
Pupil

Merge Image From Channels

Merge multiple single-channel images into a multi-channel image, useful for per-channel processing and color reconstruction.

View →
Normalize Image Intensity 0Normalize Image Intensity 1
Pupil

Normalize Image Intensity

Normalize image intensity values using minmax or histogram-based methods for consistent contrast and downstream processing.

View →
Overlay Images Using Weighted Overlay 0Overlay Images Using Weighted Overlay 1
Pupil

Overlay Images Using Weighted Overlay

Blend two images using weighted overlay for visualization, crossfade, or multi-exposure effects.

View →
Pad Image 0Pad Image 1
Pupil

Pad Image

Add padding to an image on top, bottom, left, and right with configurable border handling and fill value.

View →
Project Pixel to Camera Point 0
Pupil

Project Pixel to Camera Point

Convert a 2D pixel coordinate and depth value into a 3D point in camera coordinates using camera intrinsics and distortion coefficients.

View →
Resize Image 0Resize Image 1
Pupil

Resize Image

Resize an image by scale factor or explicit width and height for flexible scaling in vision pipelines.

View →
Resize Image With Aspect Fit 0Resize Image With Aspect Fit 1
Pupil

Resize Image With Aspect Fit

Resize an image to fit within target dimensions while preserving aspect ratio, with optional padding.

View →
Rotate Image 0Rotate Image 1
Pupil

Rotate Image

Rotate an image by a specified angle with options to keep original dimensions or expand canvas.

View →
Split Image Into Channels 0Split Image Into Channels 1
Pupil

Split Image Into Channels

Split a multi-channel image into individual color channels for per-channel processing and analysis.

View →
Transform Using Pyramid Downsampling 0Transform Using Pyramid Downsampling 1
Pupil

Transform Using Pyramid Downsampling

Downsample an image using Gaussian pyramid smoothing and subsampling for multi-scale processing and efficient image analysis.

View →
Transform Using Pyramid Upsampling 0Transform Using Pyramid Upsampling 1
Pupil

Transform Using Pyramid Upsampling

Upsample an image using Gaussian pyramid smoothing and interpolation for multi-scale reconstruction and image enlargement.

View →
Filter Image Using Morphological Thinning Filter 0Filter Image Using Morphological Thinning Filter 1
Pupil

Filter Image Using Morphological Thinning Filter

Apply skeletonization (thinning) to binary images to reduce objects to their skeletal structure while preserving connectivity and topology.

View →
Translate Image 0Translate Image 1
Pupil

Translate Image

Shift an image by a fixed number of pixels in horizontal and vertical directions with configurable border handling and interpolation.

View →
bash
python examples/pupil_examples.py --example filter_image_using_sobel

Vitreous

List all available examples and run one:

bash
python examples/vitreous_examples.py --list
bash
python examples/vitreous_examples.py --example <name>
Vitreous

Add Point Clouds

Learn how to combine multiple 3D point clouds into a single unified cloud using the Telekinesis Agentic Skill Library. Perfect for multi-view fusion, sensor aggregation, and robotics pipelines.

View →
Vitreous

Apply Transform to Point Cloud

Learn how to move, rotate, or align 3D point clouds using the Telekinesis Agentic Skill Library. Ideal for Physical AI, robotics, computer vision, and multi-view sensor pipelines.

View →
Vitreous

Calculate Axis-Aligned Bounding Box

Learn how to compute the smallest 3D axis-aligned bounding box (AABB) for a point cloud using the Telekinesis Agentic Skill Library. Ideal for Physical AI, robotics, computer vision, and scene understanding pipelines.

View →
Vitreous

Calculate Oriented Bounding Box

Learn how to compute a tightly-fitted, orientation-aware 3D bounding box (OBB) for a point cloud using the Telekinesis Agentic Skill Library. Ideal for Physical AI, robotics, computer vision, pose estimation, and grasp planning.

View →
Vitreous

Calculate Point Cloud Centroid

Learn how to compute the geometric center (centroid) of a 3D point cloud using Telekinesis Vitreous. Useful for robotics, Physical AI, object localization, grasp planning, and reference frame computation.

View →
Vitreous

Cluster Point Cloud Based on Density Jump

Segment a point cloud into clusters by detecting sharp density changes along a chosen axis using Telekinesis Agentic Skill Library. Ideal for stacked objects, layered structures, or closely packed items in robotics and Physical AI pipelines.

View →
Vitreous

Cluster Point Cloud Using DBSCAN

Segment a 3D point cloud into clusters using DBSCAN from the Telekinesis Agentic Skill Library. Ideal for detecting distinct objects, handling noise, and separating spatially distributed items in robotics and perception pipelines.

View →
Vitreous

Convert Mesh to Point Cloud

Convert 3D triangle meshes into point clouds using the Telekinesis SDK. Ideal for 6D pose estimation, registration, and robotic perception pipelines with uniform point sampling and high fidelity geometry.

View →
Vitreous

Filter Point Cloud Using Bounding Box

Extract points within a 3D axis-aligned bounding box (AABB) to isolate regions of interest in point clouds for robotics, grasp planning, and object detection.

View →
Vitreous

Filter Point Cloud Using Cylinder Base Removal

Remove base points from cylindrical meshes to isolate object geometry for robotics applications like pose estimation, grasp planning, and cylinder alignment.

View →
Vitreous

Filter Point Cloud Using Mask

Apply a 2D boolean mask to selectively filter points from an organized point cloud for robotics tasks like object segmentation, ROI extraction, and grasp planning.

View →
Vitreous

Filter Point Cloud Using Oriented Bounding Box

Crop a point cloud to a rotated 3D region using an oriented bounding box (OBB) for robotics tasks like object isolation, pose estimation, and manipulation.

View →
Vitreous

Filter Point Cloud Using Plane Defined by Point Normal Proximity

Extract points near a plane defined by a reference point and normal vector for robotics tasks like planar surface extraction, ground removal, and tabletop detection.

View →
Vitreous

Filter Point Cloud Using Plane Proximity

Extract points near a plane defined by coefficients [a, b, c, d] for robotics tasks like planar surface extraction, ground removal, and tabletop detection.

View →
Vitreous

Filter Point Cloud Using Plane Splitting

Retain points on one side of a plane using coefficients [a, b, c, d]. Ideal for robotics tasks like ground removal, workspace segmentation, and object separation.

View →
Vitreous

Filter Point Cloud Using Radius Outlier Removal

Remove isolated or noisy points in a point cloud using radius-based neighbor filtering. Ideal for denoising, preprocessing, and improving 3D perception in robotics.

View →
Vitreous

Filter Point Cloud Using Statistical Outlier Removal

Remove noise from point clouds using statistical analysis of neighbor distances. Ideal for denoising, preprocessing, and improving 3D perception in robotics pipelines.

View →
Vitreous

Filter Point Cloud Using Uniform Downsampling

Reduce point cloud density by selecting every Nth point for faster processing. Ideal for robotics pipelines, preview generation, and preprocessing of large 3D datasets.

View →
Vitreous

Filter Point Cloud Using Voxel Downsampling

Reduce point cloud density using voxel downsampling. Ideal for preprocessing, registration, clustering, and segmentation in robotics and 3D point cloud workflows.

View →
Vitreous

Project Point Cloud to Plane

Learn how to project a 3D point cloud onto a plane using general plane coefficients [a, b, c, d] with the Vitreous SDK. Useful for robotics, AI, and physical pipelines in planar alignment, ground plane removal, and feature extraction.

View →
Vitreous

Project Point Cloud to Plane Defined by Point Normal

Learn how to project a 3D point cloud onto a plane using a reference point and normal vector with the Vitreous SDK. Useful for robotics, AI, and physical pipelines in planar alignment, registration, and feature extraction.

View →
Vitreous

Reconstruct Mesh Using Convex Hull

Learn how to reconstruct a convex mesh from a 3D point cloud using the Vitreous SDK. Ideal for robotics, AI, and physical pipelines in collision geometry, grasp planning, and simplified object modeling.

View →
Vitreous

Reconstruct Mesh Using Poisson

Learn how to reconstruct a smooth, watertight 3D mesh from a point cloud using Poisson surface reconstruction with the Vitreous SDK. Ideal for high-quality object surfaces in robotics, AI, and industrial pipelines.

View →
Vitreous

Register Point Clouds Using Cuboid Translation Sampler ICP

Learn how to align two point clouds with uncertain initial translation using Cuboid Translation Sampler ICP in the Vitreous SDK. Ideal for 6D pose estimation, object alignment, and industrial robotics.

View →
Vitreous

Register Point Clouds Using Fast Global Registration

Learn how to quickly align two point clouds using Fast Global Registration (FGR) with FPFH features in the Vitreous SDK. Ideal for initial 6D pose estimation, coarse alignment, and industrial robotics.

View →
Vitreous

Register Point Clouds Using Point-to-Plane ICP

Learn how to refine point cloud alignment using Point-to-Plane ICP in the Vitreous SDK. Ideal for high-accuracy registration, fine 6D pose estimation, and industrial robotics applications.

View →
Vitreous

Register Point Clouds Using Point-to-Point ICP

Learn how to perform fine-grained point cloud registration using Point-to-Point ICP in the Vitreous SDK. Ideal for precise 6D pose estimation and object alignment in robotics and industrial applications.

View →
Vitreous

Register Point Clouds Using Rotation Sampler ICP

Learn how to perform robust point cloud registration with unknown initial rotations using Rotation Sampler ICP in the Vitreous SDK. Ideal for 6D pose estimation and object alignment in robotics and industrial applications.

View →
Vitreous

Scale Point Cloud

Learn how to uniformly scale a point cloud about a center point using the Vitreous SDK. Ideal for resizing objects and scenes in robotics, industrial pipelines, and simulations.

View →
Vitreous

Segment Point Cloud Using Color

Learn how to segment point clouds by color using the Vitreous SDK. Ideal for identifying and isolating objects based on color cues in robotics, industrial pipelines, and 3D perception.

View →
Vitreous

Segment Point Cloud Using Plane

Learn how to segment planar surfaces from point clouds using the Vitreous SDK. Ideal for detecting floors, walls, tables, and other flat surfaces in robotics, industrial pipelines, and 3D perception.

View →
Vitreous

Subtract Point Clouds

Learn how to subtract one point cloud from another using the Vitreous SDK. Ideal for isolating objects, removing backgrounds, or filtering known surfaces in robotics, industrial pipelines, and 3D perception.

View →
bash
python examples/vitreous_examples.py --example scale_point_cloud

Datatypes

List all available examples and run one:

bash
python examples/datatypes_examples.py --list
bash
python examples/datatypes_examples.py --example <name>
datatypes

Bool

Single boolean value.

View →
datatypes

Int

32-bit signed integer.

View →
datatypes

Float

32-bit floating-point number.

View →
datatypes

String

UTF-8 encoded text string.

View →
datatypes

Rgba32

Packed RGBA color representation.

View →
datatypes

Image

Image data as NumPy array or raw bytes.

View →
datatypes

ImageFormat

Image format metadata and encoding information.

View →
datatypes

Vector2D

2D vector with x and y components.

View →
datatypes

Vector3D

3D vector with x, y, and z components.

View →
datatypes

Vector4D

4D vector with x, y, z, and w components.

View →
datatypes

Mat3X3

3×3 matrix for 2D transformations.

View →
datatypes

Mat4X4

4×4 matrix for 3D transformations and poses.

View →
datatypes

Position2D

2D position with x and y coordinates.

View →
datatypes

Position3D

3D position with x, y, and z coordinates.

View →
datatypes

Points2D

2D point cloud or array of 2D points.

View →
datatypes

Points3D

3D point cloud or array of 3D points.

View →
datatypes

ListOfPoints3D

List containing multiple 3D point clouds.

View →
datatypes

Boxes2D

2D bounding boxes with multiple format support.

View →
datatypes

Boxes3D

3D bounding boxes with poses and rotations.

View →
datatypes

LineStrips2D

2D polylines and contours.

View →
datatypes

Circles

2D circles defined by centers and radii.

View →
datatypes

Ellipses

2D ellipses with centers, axes, and angles.

View →
datatypes

Lines

2D lines represented in polar form (rho, theta).

View →
datatypes

Mesh3D

3D triangle mesh with vertices and faces.

View →
datatypes

Categories

Category definitions for annotations.

View →
datatypes

ObjectDetectionAnnotations

Object detection and instance segmentation annotations.

View →
datatypes

PanopticSegmentationAnnotation

Panoptic segmentation with masks and segment information.

View →
datatypes

GeometryDetectionAnnotations

Geometric shape detection annotations for circles, ellipses, and lines.

View →
datatypes

Part

Part with ID, 6-DOF pose, dimensions, and state.

View →
datatypes

Tray

Tray container with ID, pose, dimensions, and slot count.

View →
datatypes

Bin

Bin container with ID, pose, and parts.

View →
bash
python examples/datatypes_examples.py --example bool

Medulla

Each script is run directly with:

bash
python examples/medulla/<vendor>/<script>.py
bash
python examples/medulla/webcam/quickstart.py

Synapse

Each script is run directly with:

bash
python examples/synapse/<script_or_subdir/script>.py

Connection and Motion

Kinematics

Servo Control

Force Control

State Reading

Robot Status

Diagnostics

Tools

bash
python examples/synapse/quickstart_set_cartesian_pose_universal_robots.py

Where to Go Next

Applications

Real-world use cases: pick-and-place, palletizing, quality inspection, and more.

Explore →

Explore the Docs

Support