Docs / Reference
Blocks
The 55 blocks you can put in a flow: what each does, its inputs and outputs, its settings and where it runs. Add them in a flow's editor with Add block; every page here is made from the block's own definition, so it always matches the version you have.
Data
Data read in placeDatasetA dataset of the workspace, at a fixed version: in EsaSim storage, a bucket, a cloud drive or a folder on a worker.
Runs on a workerDownload filesDownloads files or a whole dataset from the web (Mendeley Data, Zenodo, GitHub, any link), unpacks archives and keeps a sample of each folder.
Runs on a workerFiles on a workerReads files from a folder on the worker the flow runs on.
Runs on a workerFilter tableKeeps the rows of a table that match a condition.
Runs on a workerHugging Face datasetReads files of a dataset on the Hugging Face Hub at a fixed revision, all or a repeatable sample, and records the exact commit read.
EsaSim library filesLibraryFiles from the EsaSim library: 3D models, pictures, videos, logs and tables, free for testing.
Runs on a workerMergePuts the outputs of several blocks together.
Project assetsProject assetsFiles of the project's own assets (models, textures, sounds, anything it needs to work): they travel with the project on GitHub, so any worker gets them.
Runs on a workerPublish to Hugging FacePublishes the files it receives as one commit of a dataset on the Hugging Face Hub, with a card naming the licence and the credit.
Runs on a workerRead medical imagesReads CT and MR scans (NIfTI, NRRD, MHA or DICOM series), checks their geometry, converts DICOM to NIfTI and draws three slices through each, with the anatomy over them when labels are connected.
Runs on a workerSave as datasetKeeps the files it receives as a new version of a dataset, in a folder a worker shares.
Runs on a workerSelect filesKeeps the files a table selects, such as those an agent labelled keep.
Simulation
Runs on a worker3D sceneSays which 3D model each object uses and which trajectory it follows, for the 3D view and the Render block.
Runs on a workerAccelerator benchmarkChecks the worker's accelerators and measures its speed.
Runs on a workerFleet-size sweepHow many robots does the warehouse need? Hundreds of fleet-size × order-rate scenarios with inbound and outbound flow, real speeds, times, batteries and incidents, simulated at once as one batch on the CPU, an NVIDIA GPU or Tenstorrent cards.
Runs on a workerLanding sweepSimulates drone landings on a moving pad under wind, in parallel.
Runs on a workerRenderRenders a 3D scene on the worker into frames (pictures) and a video, and streams the frames while it works.
Runs on a workerSoft body modelTurns segmented anatomy into a soft-tissue model the 3D view simulates in real time: organs that sag, sway and push each other under gravity, held by a fixed skeleton and contained by the skin (metaball method of Gianluca De Novi, PhD).
Runs on a workerWarehouse fleetA warehouse of 3,600 m² run live: deliveries stored on the shelves and orders picked by up to 60 mobile robots, with real speeds, times, batteries and incidents, on the CPU, an NVIDIA GPU or Tenstorrent cards.
Runs on a workerWarehouse layoutsWhich layout works best in the same building? Several warehouse layouts with the same robots, the very same orders, deliveries and incidents, simulated and compared: throughput, order and putaway times, metres driven, waiting.
Processing
Runs on a workerCurate and splitRemoves the images the checks flagged (or a person rejected), balances the classes and splits train and validation, with a before/after report.
Runs on a workerEmbedding mapLays the embeddings out on a plane (UMAP or PCA): clusters, classes that mix and odd images, with the flags of the checks.
Runs on a workerFind duplicatesFinds copies of the same picture (resized, recompressed, slightly cropped) and, with embeddings, images that show the same thing; keeps one per group.
Runs on a workerImage previewsSmall previews of the images to look at (the flagged ones, a sample of the rest), with what the tables say about each, for a Review grid.
Runs on a workerImage quality checkOpens every image and measures its size, sharpness, exposure and contrast; flags broken, small, blurred, dark, bright or flat images with the reason.
Runs on a workerLabels to 3D modelsTurns labelled volumes (a CT segmentation, any label map or masks) into a clean 3D model per structure: one coloured GLB scene per case for the 3D view, and STL files for 3D printing.
Runs on a workerPython scriptYour own Python code: read inputs, compute, write outputs.
AI
Runs on a workerAgentReasons over your data in a loop with the LLM you connect, using skills you allow.
Runs on a workerCheck labelsFinds images whose label is likely wrong, from the labels of the images that look most like them, and images unlike any other.
Runs on a workerEmbed imagesTurns every image into a vector with a vision model (CLIP or DINOv2) on the CPU, an NVIDIA GPU or Tenstorrent cards; images per second live; optional zero-shot labels.
Settings for other blocksLLMA language model for the Agent: an EsaSim model, a provider with your key, or your own server.
Runs on a workerText to imageTurns a prompt into any number of images with a diffusion model downloaded from Hugging Face onto the worker, from small (Segmind Vega, 0.7B) to large (FLUX.1 schnell, 12B): one image per seed, on an NVIDIA GPU, a Tenstorrent card or the CPU, each shown live as it is made.
Runs on a workerText to videoTurns prompts into short videos (up to 10 seconds) with an open text-to-video model downloaded from Hugging Face onto the worker, from small (Wan 2.1, 1.3B) to the best open ones (Wan 2.2 A14B, and LTX-2.3 and LTX-2.5, which also make the sound): several variants of each prompt, one per seed, on the worker's NVIDIA GPU, each streamed live, whole, as soon as it is made.
Devices
Runs on a workerCamera captureTakes pictures or a video with a camera plugged into the worker (USB, built-in, or a network stream), with a live preview.
Runs on a workerNetworkTalks to devices and services on the worker's network: HTTP requests, TCP and UDP messages, listening, and a live bridge.
Runs on a workerxArmDrives a UFactory xArm from the worker it is connected to: status, home, moves, drawing with a pen, and live commands.
Telemetry
Visualizers
View in the browser3D viewThe project's 3D view: draws whatever the project gives it (scenes, 3D files, live positions, robots with any number of joints, several at once, fleets, rockets, vehicles), with the models, textures and sounds of the project's assets; live while a run goes on, then replays; numbers, events and controls on top.
View in the browserCameraThe camera of the computer you are using: watch it, take pictures, record videos, and send frames to running blocks.
View in the browserChartLines, areas, steps, points, bars or a histogram, from a table or a live stream.
View in the browserControlsButtons, sliders, switches, text boxes and boards of cells that send commands to the blocks of a running run.
View in the browserGaugesDials or large numbers with the latest values of a live stream, a table or metrics.
View in the browserHeatmapA grid of values as colours: a matrix from a file or the latest one of a live stream.
View in the browserImagesA gallery of images from files, and live pictures from a stream.
View in the browserMetricsKey numbers as large tiles.
View in the browserPromptA prompt box and a Generate button that start a run of the flow with your prompt, and show what it makes.
View in the browserReview gridLook at images as cards with their label, flags and reasons, filter them, compare duplicates, and decide: keep, remove or another label.
View in the browserRun timelineWhat happened during a run and how it went: values over time with the events marked on them, the list of events, and the totals.
View in the browserSoundPlays audio files, and live sound or beeps sent by a running block.
View in the browserSpeakReads text aloud with the browser's voices: messages from a running block, text files, or what you type.
View in the browserTableShows a table you can sort and search.
View in the browserTextShows reports, notes and logs as formatted text.
View in the browserVideoPlays MP4 or WebM videos produced by a block.
View in the browserVideo reviewWatch generated videos as they arrive, each played whole, and decide which to keep and which to remove; then save the kept ones into a dataset or as one zip, and browse them.
View in the browserWaveformLong signals (audio, sensors, logs of millions of samples) with zoom, scroll, a cursor and playback.