Publish to Hugging Face
Publishes the files it receives as one commit of a dataset on the Hugging Face Hub, with a card naming the licence and the credit.
How it works
Repository: owner/name of a dataset repository on the Hugging Face Hub, created if it does not exist (public, unless Private). The files keep their folders, under Folder if you give one; Replace removes what was there before, else files with the same name are updated and the others kept.
Every publish is one commit: a new version anyone can browse, download or read again at that exact revision with the Hugging Face dataset block, so a flow's output stays traceable. The card (README.md) gets the licence, the credit and the text of About; respect the licence of the data you publish.
Token: a Hugging Face access token with write access (huggingface.co > Settings > Access Tokens), kept encrypted and passed to the worker only as an environment variable.
Inputs
| Input | Takes | What it is |
|---|---|---|
Filesfiles | Files | The files to publish, in their folders Takes several connections. |
Outputs
| Output | Gives | What it is |
|---|---|---|
Publishedpublished | Metrics json | published.json: repository, commit, link, files |
Live telemetrytelemetry | Live telemetry | What the block sends while it runs, for views such as Chart or 3D view. |
Settings
| Setting | Default | What it does |
|---|---|---|
Repositoryrepo |
empty | owner/name, such as your-name/fruit-quality-curated |
Folderfolder |
empty | Folder inside the repository; empty: its top |
Tokentoken |
pasted in the editor, kept encrypted | Empty: the Hugging Face token in the profile of whoever runs the flow; it needs Write access |
Commit messagemessage |
empty | |
Licencelicence |
empty | Such as CC-BY-4.0 |
Creditcredit |
empty | Who made the data and how to cite it |
Aboutabout |
empty | What the dataset is, for its card |
Replacereplace |
off | Remove the files of Folder that are not in this publish |
Privateprivate |
off |
Where it runs
On one of your computers with the EsaSim worker: Any worker.
The worker installs the Python packages it needs when they are missing: huggingface_hub.
In its code, settings are ctx.params["key"], inputs ctx.inputs["id"] and outputs ctx.output("id", "name.ext"); see Custom blocks.