Files on a worker
Reads files from a folder on the worker the flow runs on.
How it works
Give a folder on that worker (for example D:\Data\run-12 or /data/logs) and a pattern such as *.png or *.csv. Matching files are copied into the block's output, so the next blocks can use them on any worker. Large folders: lower the limit, or keep the next blocks on the same worker.
Outputs
| Output | Gives | What it is |
|---|---|---|
Filesfiles | Files | |
File listlist | Table csv | |
Live telemetrytelemetry | Live telemetry | What the block sends while it runs, for views such as Chart or 3D view. |
Settings
| Setting | Default | What it does |
|---|---|---|
Folder on the workerfolder |
empty | Full path, as seen by the worker. |
Patternpattern |
* | For example *.png, run-*.csv |
Include subfoldersrecursive |
on | |
At most (files)limit |
500 | From 1 to 100000 |
At most (MB in total)max_mb |
200 | From 1 to 100000 |
Where it runs
On one of your computers with the EsaSim worker: Any worker.
In its code, settings are ctx.params["key"], inputs ctx.inputs["id"] and outputs ctx.output("id", "name.ext"); see Custom blocks.
More in Data
DatasetA dataset of the workspace, at a fixed version: in EsaSim storage, a bucket, a cloud drive or a folder on a worker.Download filesDownloads files or a whole dataset from the web (Mendeley Data, Zenodo, GitHub, any link), unpacks archives and keeps a sample of each folder.Filter tableKeeps the rows of a table that match a condition.Hugging Face datasetReads files of a dataset on the Hugging Face Hub at a fixed revision, all or a repeatable sample, and records the exact commit read.LibraryFiles from the EsaSim library: 3D models, pictures, videos, logs and tables, free for testing.MergePuts the outputs of several blocks together.