0.19.32

Fleets

Nodes

Maximum number of nodes

The fleet nodes.max property is now respected that allows limiting maximum number of instances allowed in a fleet. For example, to allow at most 10 instances in the fleet, you can do:

type: fleet
name: cloud-fleet
nodes: 0..10

A fleet will be considered for a run only if the run can fit into the fleet without violating nodes.max. If you don't need to enforce an upper limit, you can omit it:

type: fleet
name: cloud-fleet
nodes: 0..

Backends

Nebius

Tags

Nebius backend now supports backend and resource-level tags to tag cloud resources provisioned via dstack:

type: nebius
creds:
  type: service_account
  # ...
tags:
  team: my_team
  user: jake

Credentials file

It's also possible to configure the nebius backend using a credentials file generated by the nebius CLI:

nebius iam auth-public-key generate \
    --service-account-id <service account ID> \
    --output ~/.nebius/sa-credentials.json

projects:
- name: main
  backends:
  - type: nebius
    creds:
      type: service_account
      filename: ~/.nebius/sa-credentials.json

Hot Aisle

Hot Aisle backend now supports multi-GPU VMs such as 2xMI300X and 4xMI300X.

dstack apply -f .local/.dstack.yml --gpu amd:2
The working_dir is not set — using legacy default "/workflow". Future versions will default to the
image's working directory.

 #  BACKEND               RESOURCES                                 INSTANCE TYPE        PRICE
 1  hotaisle              cpu=26 mem=448GB disk=12288GB             2x MI300X 26x Xeon…  $3.98
    (us-michigan-1)       MI300X:192GB:2

What's changed

• Fix CLI compatibility with server 0.19.11 by @jvstme in #3145
• [Feature]: Nebius switch to using nebius iam auth-public-key generate by @peterschmidt85 in #3147
• [Docs] Move Plugins to Reference | Python API by @peterschmidt85 in #3148
• 404 error on GIT url by @robinnarsinghranabhat in #3149
• Fix idle duration: off and forbid negative durations by @r4victor in #3151
• [Docs]: GCP A4 cluster example by @jvstme in #3152
• Consider multinode replica inactive only if all jobs done by @r4victor in #3157
• Kubernetes: add NVIDIA GPU toleration by @un-def in #3160
• [Nebius] Support tags by @peterschmidt85 in #3158
• [Hot Aisle] Support multi-GPU VMs by @peterschmidt85 in #3154
• feat(docker): upgrade litestream to v0.5.0 by @DragonStuff in #3165
• [Blog] Orchestrating GPU workloads on Kubernetes by @peterschmidt85 in #3161
• Respect fleet nodes.max by @r4victor in #3164
• Fix kubeconfig via data reference by @r4victor in #3170
• [Docs] Fix kubernetes typos by @svanzoest in #3169

New contributors

• @robinnarsinghranabhat made their first contribution in #3149
• @DragonStuff made their first contribution in #3165
• @svanzoest made their first contribution in #3169

Full changelog: 0.19.31...0.19.32