0.16.0

Pools

The 0.16.0 release is the next major update, which, in addition to many bug fixes, introduces pools, a major new feature that enables a more efficient way to manage instance lifecycles and reuse instances across runs.

dstack run

Previously, when running a dev environment, task, or service, dstack provisioned an instance in a configured
backend, and upon completion of the run, deleted the instance.

Now, when using the dstack run command, it tries to reuse an instance from a pool. If no ready instance meets the
requirements, dstack automatically provisions a new one and adds it to the pool.

Once the workload finishes, the instance is marked as idle.
If the instance remains idle for the configured duration, dstack tears it down.

dstack pool

The dstack pool command allows for managing instances within pools.

To manually add an instance to a pool, use dstack pool add:

dstack pool add --gpu 80GB --idle-duration 1d

The dstack pool add command allows specifying resource requirements, along with the spot policy, idle duration, max
price, retry policy, and other policies.

If no idle duration is configured, by default, dstack sets it to 72h.
To override it, use the --idle-duration DURATION argument.

To learn more about pools, refer to the official documentation. To learn more about 0.16.0, refer to the changelog.

What's changed

• Add dstack pool by @TheBits in #880
• Pools: fix failed instance status by @Egor-S in #889
• Add columns to dstack pool show by @TheBits in #898
• Add submit stop by @TheBits in #895
• Add kubernetes logo by @plutov in #900
• Handle exceptions from backend.compute().get_offers by @r4victor in #904
• Fix process_finished_jobs parsing None job_model.job_provisioning_data by @r4victor in #905
• Validate run_name by @r4victor in #906
• Filter out private subnets when provisioning in custom aws vpc by @r4victor in #909
• Issue 894 rework failed instance status by @TheBits in #899
• Handle unexpected exceptions from run_job by @r4victor in #911
• Request GPU in docker with --gpus=all by @Egor-S in #913
• Issue 918 fix cli argimenuts for dstack pool add by @TheBits in #919
• Added router tests for pools by @TheBits in #916
• Fix #921 by @TheBits in #922

New contributors

• @plutov made their first contribution in #900

Full changelog: 0.15.1...0.16.0