Esacode

Docs / Blocks / Processing

Embedding map

Lays the embeddings out on a plane (UMAP or PCA): clusters, classes that mix and odd images, with the flags of the checks.

Runs on a worker (Python) Processing Version 1.0 Code you can open and adapt

How it works

Images that look alike sit together. UMAP keeps neighbours together best (used when installed, or chosen); PCA is exact and fast. Each point carries its label and the flags of the tables connected (quality, duplicates, labels), for a Chart (points, x and y) or a Table.

Inputs

InputTakesWhat it is
Embeddings
embeddings
Files
npy, json
embeddings.npy and paths.json of Embed images
Flags
flags
Table
csv
Tables of the checks, to mark the flagged images Optional. Takes several connections.

Outputs

OutputGivesWhat it is
Map
map
Table
csv, json
embedding_map.csv: path, x, y, label, flags
Live telemetry
telemetry
Live telemetryWhat the block sends while it runs, for views such as Chart or 3D view.

Settings

SettingDefaultWhat it does
Method
method
auto
One of: auto, UMAP, PCA
Neighbours (UMAP)
neighbours
15
From 2 to 200
Seed
seed
1

Where it runs

On one of your computers with the EsaSim worker: Any worker. The worker installs the Python packages it needs when they are missing: numpy.

In its code, settings are ctx.params["key"], inputs ctx.inputs["id"] and outputs ctx.output("id", "name.ext"); see Custom blocks.

More in Processing