Esacode

Docs / Blocks / Data

Dataset

A dataset of the workspace, at a fixed version: in EsaSim storage, a bucket, a cloud drive or a folder on a worker.

Data on a worker, read in place Data Version 1.0

How it works

Choose a dataset and its version (latest, or a number to repeat a run exactly). A dataset in a folder on a worker is read in place, so the blocks connected to it run on that worker. A dataset in EsaSim storage, a bucket or a cloud drive is downloaded by the computer that runs the next block, before it starts (worker 0.8 or later). Narrow the files with a pattern such as *.png.

The version a run read is recorded on the dataset (lineage).

Outputs

OutputGivesWhat it is
Files
files
Files

Settings

SettingDefaultWhat it does
Dataset
dataset
empty
Version
version
latest latest, or a version number such as 3
Only these files
pattern
* Patterns separated by commas, like *.png, *.jpg
At most (files)
limit
200000
From 1 to 200000

Where it runs

Its settings are used by the blocks connected to it; see Blueprints.

More in Data