Skip to content

Skills: Models & Algorithms for Physical AI ​

SUMMARY

Skills are reusable modular operations for robotic perception, motion, and planning that can be chained into workflows for Physical AI applications in manufacturing, logistics and more.

Every Skill is one Python call with strictly typed inputs and outputs, so the output of one Skill feeds directly into the next. New here? Start with What is a Skill?

0:00 / 0:00

A tour of the Skill Library: robot motion and control, image segmentation, motion planning, object detection, reinforcement learning, image processing, model training and 3D point cloud processing.

Browse the Skill Library ​

381 skills

Image Segmentation Skills 21

Segment Image Using SAM3Cornea

Segment Image Using SAM3

Segment objects using text prompts and/or bounding boxes with Meta's Segment Anything Model 3 (SAM3), a deep-learning alternative to GrabCut for precise per-object masks.

Segment Image Using RGBCornea

Segment Image Using RGB

Perform image segmentation based on RGB color ranges to identify objects by their specific color values.

Segment Image Using HSVCornea

Segment Image Using HSV

Perform robust color-based segmentation using HSV color space, separating hue, saturation, and value for consistent detection under varying lighting conditions.

Segment Image Using LABCornea

Segment Image Using LAB

Perform perceptually uniform color-based segmentation using LAB color space, ideal for matching human color perception in image processing tasks.

Segment Image Using YCrCbCornea

Segment Image Using YCrCb

Perform YCrCb color space segmentation to detect objects based on chrominance, commonly used for skin detection and face detection.

Segment Image Using Flood FillCornea

Segment Image Using Flood Fill

Flood fill image segmentation for extracting connected regions based on a seed point and color tolerance for computer vision and image processing pipelines.

Segment Image Using WatershedCornea

Segment Image Using Watershed

Perform marker-based watershed segmentation to separate touching or overlapping objects in an image.

Segment Image Using Focus RegionCornea

Segment Image Using Focus Region

Focus region segmentation for identifying in-focus areas based on image sharpness for computer vision, depth estimation, and image processing pipelines.

Segment Image Using Otsu ThresholdCornea

Segment Image Using Otsu Threshold

Automatically segment an image with a single global threshold chosen by Otsu's method, ideal for clearly bimodal intensity histograms.

Segment Image Using Local ThresholdCornea

Segment Image Using Local Threshold

Segment images with non-uniform lighting or varying background intensity using a single-parameter, neighborhood-based local threshold.

Segment Image Using Yen ThresholdCornea

Segment Image Using Yen Threshold

Automatically segment an image with a single global threshold chosen by Yen's entropy-based method, a parameter-free alternative to Otsu thresholding.

Segment Image Using ThresholdCornea

Segment Image Using Threshold

Perform manual global threshold segmentation with a chosen pixel value and one of five comparison modes to create a labeled segmentation mask.

Segment Image Using Adaptive ThresholdCornea

Segment Image Using Adaptive Threshold

Adaptive per-pixel threshold segmentation for images with non-uniform lighting, shadows, and varying intensity, with control over the local-averaging method and comparison direction.

Segment Image Using Laplacian ThresholdCornea

Segment Image Using Laplacian Threshold

Segment an image's edge-rich, textured regions from its smooth regions by thresholding the Laplacian (second-derivative) edge response.

Segment Image Using FelzenszwalbCornea

Segment Image Using Felzenszwalb

Generate irregularly-shaped, boundary-following superpixels with Felzenszwalb's graph-based segmentation algorithm.

Segment Image Using SLIC SuperpixelCornea

Segment Image Using SLIC Superpixel

Generate compact, near-uniform superpixels with the SLIC (Simple Linear Iterative Clustering) algorithm for predictable over-segmentation.

Filter Segments By AreaCornea

Filter Segments By Area

Remove segments smaller or larger than a given pixel-area range from an existing label map, discarding noise or implausibly large regions.

Filter Segments By ColorCornea

Filter Segments By Color

Remove segments from an existing label map whose mean pixel intensity falls outside a given range, keeping only bright or dark regions of interest.

Filter Segments By MaskCornea

Filter Segments By Mask

Keep only the segments of an existing label map that overlap a region-of-interest mask, discarding the rest.

Segment Image Using GrabCutCornea

Segment Image Using GrabCut

Perform foreground/background segmentation using GrabCut, an iterative graph cut algorithm for interactive object extraction and background removal.

Segment Image Using Foreground BiRefNetCornea

Segment Image Using Foreground BiRefNet

Segment the salient foreground object from the background using BiRefNet, a deep-learning model that needs no bounding box or seed point.

Object Detection Skills 6

3D Point Cloud Processing Skills 21

Vitreous

Calculate Axis Aligned Bounding Box

Learn how to compute the smallest 3D axis-aligned bounding box (AABB) for a point cloud using the Telekinesis Agentic Skill Library. Ideal for Physical AI, robotics, computer vision, and scene understanding pipelines.

Vitreous

Calculate Oriented Bounding Box

Learn how to compute a tightly-fitted, orientation-aware 3D bounding box (OBB) for a point cloud using the Telekinesis Agentic Skill Library. Ideal for Physical AI, robotics, computer vision, pose estimation, and grasp planning.

Vitreous

Calculate Plane Normal

Learn how to compute the normal vector of a plane from its coefficients using the Telekinesis Agentic Skill Library. Ideal for Physical AI, robotics, computer vision, surface alignment, and plane-based reasoning.

Vitreous

Calculate Point Cloud Centroid

Learn how to compute the geometric center (centroid) of a 3D point cloud using Telekinesis Vitreous. Useful for robotics, Physical AI, object localization, grasp planning, and reference frame computation.

Vitreous

Cluster Point Cloud Based on Density Jump

Segment a point cloud into clusters by detecting sharp density changes along a chosen axis using Telekinesis Agentic Skill Library. Ideal for stacked objects, layered structures, or closely packed items in robotics and Physical AI pipelines.

Vitreous

Cluster Point Cloud Using DBSCAN

Segment a 3D point cloud into clusters using DBSCAN from the Telekinesis Agentic Skill Library. Ideal for detecting distinct objects, handling noise, and separating spatially distributed items in robotics and perception pipelines.

vitreous.convert_depth_image_to_point_cloud()Vitreous

Convert Depth Image to Point Cloud

Back-project a depth image into a 3D point cloud using a pinhole camera model and camera intrinsics, with the Telekinesis SDK. Ideal for turning RGB-D/depth sensor output into point clouds for robotics perception pipelines.

vitreous.convert_mesh_to_point_cloud()Vitreous

Convert Mesh to Point Cloud

Convert 3D triangle meshes into point clouds using the Telekinesis SDK. Ideal for 6D pose estimation, registration, and robotic perception pipelines with controlled point sampling density.

Vitreous

Create Cylinder Mesh

Generate a 3D cylinder mesh using the Telekinesis SDK for pose estimation, 3D detection, and robotics perception pipelines. Ideal for representing rods, pipes, and cylindrical objects with precise geometry.

Vitreous

Create Plane Mesh

Generate a 3D plane or cuboid mesh using the Telekinesis SDK for pose estimation, 3D detection, and robotics perception pipelines. Ideal for representing floors, walls, tabletops, or planar reference surfaces.

Vitreous

Create Sphere Mesh

Generate a 3D spherical mesh using the Telekinesis SDK for pose estimation, 3D detection, and robotics perception pipelines. Ideal for representing balls, spherical markers, or rounded components with precise geometry.

Vitreous

Create Torus Mesh

Generate a 3D torus mesh using the Telekinesis SDK for pose estimation, 3D detection, and robotics perception pipelines. Ideal for representing rings, wheels, or circular components with parametric precision.

Estimate Depth Using Fast-FoundationStereoVitreous

Estimate Depth Using Fast-FoundationStereo

Estimate a metric depth map from a rectified stereo image pair using NVIDIA's Fast-FoundationStereo, a real-time zero-shot stereo-matching model, with the Telekinesis SDK. No per-scene calibration or fine-tuning required.

vitreous.estimate_pose_using_foundation_pose()Vitreous

Estimate Pose Using FoundationPose

Estimate and track a 6-DOF object pose from an RGB-D frame and a CAD mesh using NVIDIA's FoundationPose, a zero-shot pose estimation and tracking model, with the Telekinesis SDK. No per-object training required.

Vitreous

Estimate Principal Axis Within Radius

Compute the dominant local direction of a 3D point cloud neighborhood using PCA for grasp planning, fine manipulation, and local feature analysis in industrial robotics.

Vitreous

Estimate Principal Axes

Compute the principal directions of a 3D point cloud using PCA or OBB for industrial robotic manipulation, grasp planning, and object orientation estimation.

Vitreous

Filter Point Cloud Using Pass Through Filter

Retain points within specified axis-aligned bounds using a passthrough filter for robotics tasks like workspace region extraction, object isolation, and perception.

Vitreous

Filter Point Cloud Using Bounding Box

Extract points within a 3D axis-aligned bounding box (AABB) to isolate regions of interest in point clouds for robotics, grasp planning, and object detection.

Vitreous

Filter Mesh Using Cylinder Base Removal

Remove base points from cylindrical meshes to isolate object geometry for robotics applications like pose estimation, grasp planning, and cylinder alignment.

Vitreous

Filter Point Cloud Using Mask

Apply a 2D boolean mask to selectively filter points from an organized point cloud for robotics tasks like object segmentation, ROI extraction, and grasp planning.

Vitreous

Filter Point Cloud Using Oriented Bounding Box

Crop a point cloud to a rotated 3D region using an oriented bounding box (OBB) for robotics tasks like object isolation, pose estimation, and manipulation.