0.19.33

Kubernetes

AMD

The kubernetes backend now allows you to run workloads on AMD GPU-enabled Kubernetes clusters.

UI

Dev environments

You can now configure and provision dev environments directly from the user interface.

create-dev-environment-2.mp4

Note

CLI version 0.19.33 or later is required to attach to runs created from the UI.

GCP

Reservations

You can now configure specifically-targeted GCP reservations in fleet configurations to leverage reserved compute capacity:

type: fleet
nodes: 4
placement: cluster
backends: [gcp]
reservation: my-reservation

For reservations shared between projects, use the full syntax:

type: fleet
nodes: 4
placement: cluster
backends: [gcp]
reservation: projects/my-proj/reservations/my-reservation

dstack will automatically locate the specified reservation, match offers to the reservation's properties, and provision instances within the reservation. If there are multiple reservations with the specified name, all of them will be considered for provisioning.

Note

Using reservations requires the compute.reservations.list permission in the project that owns the reservation.

G4 preview

If your GCP project has access to the preview G4 instance type, you can now try it out with dstack.

> dstack offer -b gcp --gpu RTXPRO6000

 #  BACKEND            RESOURCES                                      INSTANCE TYPE   PRICE
 1  gcp (us-central1)  cpu=48 mem=180GB disk=100GB RTXPRO6000:96GB:1  g4-standard-48  $0

To use G4, enable its preview in the backend settings.

projects:
- name: main
  backends:
  - type: gcp
    project_id: my-project
    creds:
      type: default
    preview_features: [g4]

Hot Aisle

The hotaisle backend now supports 8x MI300X instances too.

> dstack offer -b hotaisle --gpu 8:MI300X                         

 #  BACKEND                   RESOURCES                                       INSTANCE TYPE                      PRICE    
 1  hotaisle (us-michigan-1)  cpu=104 mem=1792GB disk=12288GB MI300X:192GB:8  8x MI300X 104x Xeon Platinum 8470  $15.92

Docker

Default image

The default Docker image now uses CUDA 12.8 (updated from 12.1).

What's changed

• Fix version descriptions on Sky index page by @jvstme in #3153
• [Internal] Minor just improvements by @peterschmidt85 in #3173
• [Docker] Update the CUDA version in the default Docker image to 12.8 (from 12.1) by @peterschmidt85 in #3166
• [HotAisle] 4x MI300X 52x Xeon Platinum 8470 is skipped by @peterschmidt85 in #3175
• [Internal] Updated amd-smi CI/CD by @peterschmidt85 in #3179
• Make kubeconfig filename optional in server/config.yml by @r4victor in #3189
• [HotAisle] Support 8xMI300X instances by @peterschmidt85 in #3188
• [GCP] Support G4 preview instance type by @peterschmidt85 in #3181
• [UX] Improved UX of the project settings CLI section by @peterschmidt85 in #3183
• [UI] A prototype of the "Connect" section to show on the running dev environment page (WIP) by @peterschmidt85 in #3184
• Support GCP reservations by @jvstme in #3186
• [Feature]: Store user SSH key on the server by @peterschmidt85 in #3176
• [Internal] Extend _CREATE_USER_HOOKS with an optional config by @peterschmidt85 in #3192
• Run wizzard by @olgenn in #3191
• fix(VastAICompute): filter region before offer by @DragonStuff in #3193
• Kubernetes: add AMD GPU support by @un-def in #3178
• Fix CLI incompatibility with older /get_my_user by @jvstme in #3198

Full changelog: 0.19.32...0.19.33