0.18.34

Idle duration

If provisioned fleet instances aren’t used, they are marked as idle for reuse within the configured idle duration. After this period, instances are automatically deleted. This behavior was previously configured using the termination_policy and termination_idle_time properties in run or fleet configurations.

With this update, we replace these two properties with idle_duration, a simpler way to configure this behavior. This property can be set to a specific duration or to off for unlimited time.

type: dev-environment
name: vscode

python: "3.11"
ide: vscode

# Terminate instances idle for more than 1 hour
idle_duration: 1h

resources:
  gpu: 24GB

Docker

Previously, dstack had limitations on Docker images for dev environments, tasks, and services. These have now been lifted, allowing images based on various Linux distributions like Alpine, Rocky Linux, and Fedora.

dstack now also supports Docker images with built-in OpenSSH servers, which previously caused issues.

Documentation

The documentation has been significantly improved:

• Backend configuration has been moved from the Reference page to Concepts→Backends.
• Major examples related to dev environments, tasks, and services have been relocated from the Reference page to their respective Concepts pages.

Deprecations

• The termination_idle_time and termination_policy parameters in run configurations have been deprecated in favor of idle_duration.

What's changed

• [dstack-shim] Implement Future API by @un-def in #2141
• [API] Add API support to get runs by id by @r4victor in #2157
• [TPU] Update TPU v5e runtime and update vllm-tpu example by @Bihan in #2155
• [Internal] Skip docs-build on PRs from forks by @r4victor in #2159
• [dstack-shim] Add API v2 compat support to ShimClient by @un-def in #2156
• [Run configurations] Support Alpine and more RPM-based images by @un-def in #2151
• [Internal] Omit id field in (API) Client.runs.get() method by @un-def in #2174
• [dstack-shim] Remove API v1 by @un-def in #2160
• [Volumes] Fix volume attachment with dstack backend by @un-def in #2175
• Replace termination_policy and termination_idle_time with idle_duration: int|str|off by @peterschmidt85 in #2167
• Allow running sshd in dstack runs by @jvstme in #2178
• [Docs] Many docs improvements by @peterschmidt85 in #2171

Full changelog: 0.18.33...0.18.34