Skip to content

Cluster app: capability map + live placement + move things across nodes + agent-assisted auto-organise #897

@jaylfc

Description

@jaylfc

Vision (Jay 2026-06-14)

Make the Cluster app the place to SEE and ORGANISE the whole cluster's capabilities and placement.

Must-haves

  • See what capabilities you have across the cluster (image-gen, chat/LLM, embeddings, rerank, vision, TTS/STT, etc.), aggregated from all nodes.
  • See where things are installed / live (which model/backend runs on which node, loaded vs installed-but-stopped, VRAM/RAM use, health).
  • Move things around the cluster: drag a model/backend from one node to another (relocate where a capability runs). Builds on the Visual Resource Manager idea (RPG-inventory drag-drop).
  • Auto-organise with the taOS agent: the agent reads the cluster state + the optimiser's suggestions and proposes (or applies) a better layout for the user's hardware and goals (e.g. move the image model to the GPU box, keep small chat on the NPU). One-click apply with a clear before/after.

Build on what exists

  • desktop/src/apps/ClusterApp.tsx (the app to evolve).
  • tinyagentos/cluster/capabilities.py (capability model), cluster/optimiser.py (placement optimisation -> the auto-organise engine), cluster/manager.py (ClusterManager), cluster/router.py (capability routing).
  • The describe_image_capabilities agent tool already gives read-only capability awareness for one domain; generalise that view.

Tie-ins

Notes

End-users never need the terminal: moves/auto-organise are UI actions with clear guidance. Hardware is heterogeneous, so the view adapts to what the user actually has. Brainstorm -> spec; do not block the storybook demo.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    Status
    Todo

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions