diff --git a/README.md b/README.md index e483922690..766c35c2bc 100644 --- a/README.md +++ b/README.md @@ -21,12 +21,13 @@ `dstack` supports `NVIDIA`, `AMD`, `Google TPU`, `Intel Gaudi`, and `Tenstorrent` accelerators out of the box. ## Latest news ✨ - +- [2025/07] [dstack 0.19.17: Secrets, Files, Rolling deployment](https://github.com/dstackai/dstack/releases/tag/0.19.17) +- [2025/06] [dstack 0.19.16: Docker in Docker, CloudRift](https://github.com/dstackai/dstack/releases/tag/0.19.16) +- [2025/06] [dstack 0.19.13: InfiniBand support in default images](https://github.com/dstackai/dstack/releases/tag/0.19.13) +- [2025/06] [dstack 0.19.12: Simplified use of MPI](https://github.com/dstackai/dstack/releases/tag/0.19.12) +- [2025/05] [dstack 0.19.10: Priorities](https://github.com/dstackai/dstack/releases/tag/0.19.10) - [2025/05] [dstack 0.19.8: Nebius clusters, GH200 on Lambda](https://github.com/dstackai/dstack/releases/tag/0.19.8) - [2025/04] [dstack 0.19.6: Tenstorrent, Plugins](https://github.com/dstackai/dstack/releases/tag/0.19.6) -- [2025/04] [dstack 0.19.5: GCP A3 High clusters](https://github.com/dstackai/dstack/releases/tag/0.19.5) -- [2025/04] [dstack 0.19.3: GCP A3 Mega clusters](https://github.com/dstackai/dstack/releases/tag/0.19.3) -- [2025/03] [dstack 0.19.0: Prometheus](https://github.com/dstackai/dstack/releases/tag/0.19.0) ## How does it work? diff --git a/docs/assets/stylesheets/extra.css b/docs/assets/stylesheets/extra.css index 82e80e658a..45d69f9067 100644 --- a/docs/assets/stylesheets/extra.css +++ b/docs/assets/stylesheets/extra.css @@ -1318,7 +1318,7 @@ html .md-footer-meta.md-typeset a:is(:focus,:hover) { display: none; } - .md-tabs__item:nth-child(6) { + .md-tabs__item:nth-child(7) { display: none; } @@ -1694,7 +1694,7 @@ a.md-go-to-action.secondary { background: white; } -.md-post__content h2 a { +.md-post__content :is(h2, h3, h4, h5, h6) a { color: rgba(0,0,0,0.87); } diff --git a/docs/blog/posts/amd-on-runpod.md b/docs/blog/posts/amd-on-runpod.md index d9d948cf62..1e32a27e7d 100644 --- a/docs/blog/posts/amd-on-runpod.md +++ b/docs/blog/posts/amd-on-runpod.md @@ -4,7 +4,7 @@ date: 2024-08-21 description: "dstack, the open-source AI container orchestration platform, adds support for AMD accelerators, with RunPod as the first supported cloud provider." slug: amd-on-runpod categories: - - Releases + - Changelog --- # Supporting AMD accelerators on RunPod diff --git a/docs/blog/posts/changelog-07-25.md b/docs/blog/posts/changelog-07-25.md new file mode 100644 index 0000000000..13bf67f54a --- /dev/null +++ b/docs/blog/posts/changelog-07-25.md @@ -0,0 +1,204 @@ +--- +title: "Rolling deployment, Secrets, Files, Tenstorrent, and more" +date: 2025-07-10 +description: "TBA" +slug: changelog-07-25 +image: https://dstack.ai/static-assets/static-assets/images/changelog-07-25.png +categories: + - Changelog +--- + +# Rolling deployment, Secrets, Files, Tenstorrent, and more + +Thanks to feedback from the community, `dstack` continues to evolve. Here’s a look at what’s new. + +#### Rolling deployments + +Previously, updating running services could cause downtime. The latest release fixes this with [rolling deployments](../../docs/concepts/services.md/#rolling-deployment). Replicas are now updated one by one, allowing uninterrupted traffic during redeployments. + +
+ +```shell +$ dstack apply -f .dstack.yml + +Active run my-service already exists. Detected changes that can be updated in-place: +- Repo state (branch, commit, or other) +- File archives +- Configuration properties: + - env + - files + +Update the run? [y/n]: y +⠋ Launching my-service... + + NAME BACKEND PRICE STATUS SUBMITTED + my-service deployment=1 running 11 mins ago + replica=0 deployment=0 aws (us-west-2) $0.0026 terminating 11 mins ago + replica=1 deployment=1 aws (us-west-2) $0.0026 running 1 min ago +``` + +
+ + + +#### Secrets + +Secrets let you centrally manage sensitive data like API keys and credentials. They’re scoped to a project, managed by project admins, and can be [securely referenced](../../docs/concepts/secrets.md) in run configurations. + +
+ +```yaml hl_lines="7" +type: task +name: train + +image: nvcr.io/nvidia/pytorch:25.05-py3 +registry_auth: + username: $oauthtoken + password: ${{ secrets.ngc_api_key }} + +commands: + - git clone https://github.com/pytorch/examples.git pytorch-examples + - cd pytorch-examples/distributed/ddp-tutorial-series + - pip install -r requirements.txt + - | + torchrun \ + --nproc-per-node=$DSTACK_GPUS_PER_NODE \ + --nnodes=$DSTACK_NODES_NUM \ + multinode.py 50 10 + +resources: + gpu: H100:1..2 + shm_size: 24GB +``` + +
+ +#### Files + +By default, `dstack` mounts the repo directory (where you ran `dstack init`) to all runs. + +If the directory is large or you need files outside of it, use the new [files](../../docs/concepts/dev-environments/#files) property to map specific local paths into the container. + +
+ +```yaml +type: task +name: trl-sft + +files: + - .:examples # Maps the directory where `.dstack.yml` to `/workflow/examples` + - ~/.ssh/id_rsa:/root/.ssh/id_rsa # Maps `~/.ssh/id_rsa` to `/root/.ssh/id_rs + +python: 3.12 + +env: + - HF_TOKEN + - HF_HUB_ENABLE_HF_TRANSFER=1 + - MODEL=Qwen/Qwen2.5-0.5B + - DATASET=stanfordnlp/imdb + +commands: + - uv pip install trl + - | + trl sft \ + --model_name_or_path $MODEL --dataset_name $DATASET + --num_processes $DSTACK_GPUS_PER_NODE + +resources: + gpu: H100:1 +``` + +
+ +#### Tenstorrent + +`dstack` remains committed to supporting multiple GPU vendors—including NVIDIA, AMD, TPUs, and more recently, [Tenstorrent :material-arrow-top-right-thin:{ .external }](https://tenstorrent.com/){:target="_blank"}. The latest release improves Tenstorrent support by handling hosts with multiple N300 cards and adds Docker-in-Docker support. + + + +Huge thanks to the Tenstorrent community for testing these improvements! + +#### Docker in Docker + +Using Docker inside `dstack` run configurations is now even simpler. Just set `docker` to `true` to [enable the use of Docker CLI](../../docs/concepts/tasks.md#docker-in-docker) in your runs—allowing you to build images, run containers, use Docker Compose, and more. + +
+ +```yaml +type: task +name: docker-nvidia-smi + +docker: true + +commands: + - | + docker run --gpus all \ + nvidia/cuda:12.3.0-base-ubuntu22.04 \ + nvidia-smi + +resources: + gpu: H100:1 +``` + +
+ +#### AWS EFA + +EFA is a network interface for EC2 that enables low-latency, high-bandwidth communication between nodes—crucial for scaling distributed deep learning. With `dstack`, EFA is automatically enabled when using supported instance types in fleets. Check out our [example](../../examples/clusters/efa/index.md) + +#### Default Docker images + +If no `image` is specified, `dstack` uses a base Docker image that now comes pre-configured with `uv`, `python`, `pip`, essential CUDA drivers, InfiniBand, and NCCL tests (located at `/opt/nccl-tests/build`). + +
+ +```yaml +type: task +name: nccl-tests + +nodes: 2 + +startup_order: workers-first +stop_criteria: master-done + +env: + - NCCL_DEBUG=INFO +commands: + - | + if [ $DSTACK_NODE_RANK -eq 0 ]; then + mpirun \ + --allow-run-as-root \ + --hostfile $DSTACK_MPI_HOSTFILE \ + -n $DSTACK_GPUS_NUM \ + -N $DSTACK_GPUS_PER_NODE \ + --bind-to none \ + /opt/nccl-tests/build/all_reduce_perf -b 8 -e 8G -f 2 -g 1 + else + sleep infinity + fi + +resources: + gpu: nvidia:1..8 + shm_size: 16GB +``` + +
+ +These images are optimized for common use cases and kept lightweight—ideal for everyday development, training, and inference. + +#### Server performance + +Server-side performance has been improved. With optimized handling and background processing, each server replica can now handle more runs. + +#### Google SSO + +Alongside the open-source version, `dstack` also offers [dstack Enterprise :material-arrow-top-right-thin:{ .external }](https://github.com/dstackai/dstack-enterprise){:target="_blank"} — which adds dedicated support and extra integrations like Single Sign-On (SSO). The latest release introduces support for configuring your company’s Google account for authentication. + + + +If you’d like to learn more about `dstack` Enterprise, [let us know](https://calendly.com/dstackai/discovery-call). + +That’s all for now. + +!!! info "What's next?" + Give dstack a try, and share your feedback—whether it’s [GitHub :material-arrow-top-right-thin:{ .external }](https://github.com/dstackai/dstack){:target="_blank"} issues, PRs, or questions on [Discord :material-arrow-top-right-thin:{ .external }](https://discord.gg/u8SmfwPpMd){:target="_blank"}. We’re eager to hear from you! diff --git a/docs/blog/posts/cursor.md b/docs/blog/posts/cursor.md index bdc1e4a619..a5f9604698 100644 --- a/docs/blog/posts/cursor.md +++ b/docs/blog/posts/cursor.md @@ -5,7 +5,7 @@ description: "TBA" slug: cursor image: https://dstack.ai/static-assets/static-assets/images/dstack-cursor-v2.png categories: - - Releases + - Changelog --- # Accessing dev environments with Cursor diff --git a/docs/blog/posts/dstack-metrics.md b/docs/blog/posts/dstack-metrics.md index f06ff31515..f4647d7822 100644 --- a/docs/blog/posts/dstack-metrics.md +++ b/docs/blog/posts/dstack-metrics.md @@ -5,7 +5,7 @@ description: "dstack introduces a new CLI command (and API) for monitoring conta slug: dstack-metrics image: https://dstack.ai/static-assets/static-assets/images/dstack-stats-v2.png categories: - - Releases + - Changelog --- # Monitoring essential GPU metrics via CLI diff --git a/docs/blog/posts/dstack-sky-own-cloud-accounts.md b/docs/blog/posts/dstack-sky-own-cloud-accounts.md index ff0b8d1826..16b68867ce 100644 --- a/docs/blog/posts/dstack-sky-own-cloud-accounts.md +++ b/docs/blog/posts/dstack-sky-own-cloud-accounts.md @@ -4,7 +4,7 @@ date: 2024-06-11 description: "With today's release, dstack Sky supports both options: accessing the GPU marketplace and using your own cloud accounts." slug: dstack-sky-own-cloud-accounts categories: - - Releases + - Changelog --- # dstack Sky now supports your own cloud accounts diff --git a/docs/blog/posts/dstack-sky.md b/docs/blog/posts/dstack-sky.md index 7cfe800970..78d35641c0 100644 --- a/docs/blog/posts/dstack-sky.md +++ b/docs/blog/posts/dstack-sky.md @@ -3,7 +3,7 @@ date: 2024-03-11 description: A managed service that enables you to get GPUs at competitive rates from a wide pool of providers. slug: dstack-sky categories: - - Releases + - Changelog --- # Introducing dstack Sky diff --git a/docs/blog/posts/gh200-on-lambda.md b/docs/blog/posts/gh200-on-lambda.md index 970c87b12f..1741e6f2ec 100644 --- a/docs/blog/posts/gh200-on-lambda.md +++ b/docs/blog/posts/gh200-on-lambda.md @@ -5,7 +5,7 @@ description: "TBA" slug: gh200-on-lambda image: https://dstack.ai/static-assets/static-assets/images/dstack-arm--gh200-lambda-min.png categories: - - Releases + - Changelog --- # Supporting ARM and NVIDIA GH200 on Lambda diff --git a/docs/blog/posts/gpu-blocks-and-proxy-jump.md b/docs/blog/posts/gpu-blocks-and-proxy-jump.md index dc8bea1dfc..cbf9ab7dcc 100644 --- a/docs/blog/posts/gpu-blocks-and-proxy-jump.md +++ b/docs/blog/posts/gpu-blocks-and-proxy-jump.md @@ -5,7 +5,7 @@ description: "TBA" slug: gpu-blocks-and-proxy-jump image: https://dstack.ai/static-assets/static-assets/images/data-centers-and-private-clouds.png categories: - - Releases + - Changelog --- # Introducing GPU blocks and proxy jump for SSH fleets diff --git a/docs/blog/posts/inactivity-duration.md b/docs/blog/posts/inactivity-duration.md index 28ea3f5d70..d04a8eba46 100644 --- a/docs/blog/posts/inactivity-duration.md +++ b/docs/blog/posts/inactivity-duration.md @@ -5,7 +5,7 @@ description: "dstack introduces a new feature that automatically detects and shu slug: inactivity-duration image: https://dstack.ai/static-assets/static-assets/images/inactive-dev-environments-auto-shutdown.png categories: - - Releases + - Changelog --- # Auto-shutdown for inactive dev environments—no idle GPUs diff --git a/docs/blog/posts/instance-volumes.md b/docs/blog/posts/instance-volumes.md index c4f5e3b1b1..95b48cee11 100644 --- a/docs/blog/posts/instance-volumes.md +++ b/docs/blog/posts/instance-volumes.md @@ -5,7 +5,7 @@ description: "To simplify caching across runs and the use of NFS, we introduce a image: https://dstack.ai/static-assets/static-assets/images/dstack-instance-volumes.png slug: instance-volumes categories: - - Releases + - Changelog --- # Introducing instance volumes to persist data on instances diff --git a/docs/blog/posts/intel-gaudi.md b/docs/blog/posts/intel-gaudi.md index 7abc69f418..6f95f49d0a 100644 --- a/docs/blog/posts/intel-gaudi.md +++ b/docs/blog/posts/intel-gaudi.md @@ -5,7 +5,7 @@ description: "dstack now supports Intel Gaudi accelerators with SSH fleets, simp slug: intel-gaudi image: https://dstack.ai/static-assets/static-assets/images/dstack-intel-gaudi-and-intel-tiber-cloud.png-v2 categories: - - Releases + - Changelog --- # Supporting Intel Gaudi AI accelerators with SSH fleets diff --git a/docs/blog/posts/metrics-ui.md b/docs/blog/posts/metrics-ui.md index 74719af2de..b15bbffc5e 100644 --- a/docs/blog/posts/metrics-ui.md +++ b/docs/blog/posts/metrics-ui.md @@ -5,7 +5,7 @@ description: "TBA" slug: metrics-ui image: https://dstack.ai/static-assets/static-assets/images/dstack-metrics-ui-v3-min.png categories: - - Releases + - Changelog --- # Built-in UI for monitoring essential GPU metrics diff --git a/docs/blog/posts/mpi.md b/docs/blog/posts/mpi.md index ef5d685829..5473d64a28 100644 --- a/docs/blog/posts/mpi.md +++ b/docs/blog/posts/mpi.md @@ -5,7 +5,7 @@ description: "TBA" slug: mpi image: https://dstack.ai/static-assets/static-assets/images/dstack-mpi-v2.png categories: - - Releases + - Changelog --- # Supporting MPI and NCCL/RCCL tests diff --git a/docs/blog/posts/nebius.md b/docs/blog/posts/nebius.md index c6f4374db7..ef484b0f32 100644 --- a/docs/blog/posts/nebius.md +++ b/docs/blog/posts/nebius.md @@ -5,7 +5,7 @@ description: "TBA" slug: nebius image: https://dstack.ai/static-assets/static-assets/images/dstack-nebius-v2.png categories: - - Releases + - Changelog --- # Supporting GPU provisioning and orchestration on Nebius diff --git a/docs/blog/posts/nvidia-and-amd-on-vultr.md b/docs/blog/posts/nvidia-and-amd-on-vultr.md index eda4519b40..2fb30ebbc0 100644 --- a/docs/blog/posts/nvidia-and-amd-on-vultr.md +++ b/docs/blog/posts/nvidia-and-amd-on-vultr.md @@ -5,7 +5,7 @@ description: "Introducing integration with Vultr: The new integration allows Vul slug: nvidia-and-amd-on-vultr image: https://dstack.ai/static-assets/static-assets/images/dstack-vultr.png categories: - - Releases + - Changelog --- # Supporting NVIDIA and AMD accelerators on Vultr diff --git a/docs/blog/posts/prometheus.md b/docs/blog/posts/prometheus.md index 58299dfb4d..5482d0c131 100644 --- a/docs/blog/posts/prometheus.md +++ b/docs/blog/posts/prometheus.md @@ -5,7 +5,7 @@ description: "TBA" slug: prometheus image: https://dstack.ai/static-assets/static-assets/images/dstack-prometheus-v3.png categories: - - Releases + - Changelog --- # Exporting GPU, cost, and other metrics to Prometheus diff --git a/docs/blog/posts/tpu-on-gcp.md b/docs/blog/posts/tpu-on-gcp.md index c38bea20a2..8fff83cb47 100644 --- a/docs/blog/posts/tpu-on-gcp.md +++ b/docs/blog/posts/tpu-on-gcp.md @@ -4,7 +4,7 @@ date: 2024-09-10 description: "Learn how to use TPUs with dstack for fine-tuning and deploying LLMs, leveraging open-source tools like Hugging Face’s Optimum TPU and vLLM." slug: tpu-on-gcp categories: - - Releases + - Changelog --- # Using TPUs for fine-tuning and deploying LLMs diff --git a/docs/blog/posts/volumes-on-runpod.md b/docs/blog/posts/volumes-on-runpod.md index a6d436790e..de0c8d6d0a 100644 --- a/docs/blog/posts/volumes-on-runpod.md +++ b/docs/blog/posts/volumes-on-runpod.md @@ -4,7 +4,7 @@ date: 2024-08-13 description: "Learn how to use volumes with dstack to optimize model inference cold start times on RunPod." slug: volumes-on-runpod categories: - - Releases + - Changelog --- # Using volumes to optimize cold starts on RunPod diff --git a/docs/overrides/header-2.html b/docs/overrides/header-2.html index 2c7e676796..4f8542d383 100644 --- a/docs/overrides/header-2.html +++ b/docs/overrides/header-2.html @@ -62,7 +62,7 @@
GitHub - Discord +
{% if "navigation.tabs.sticky" in features %} diff --git a/docs/overrides/home.html b/docs/overrides/home.html index 8c306dd369..b7c3ee994a 100644 --- a/docs/overrides/home.html +++ b/docs/overrides/home.html @@ -509,20 +509,20 @@

FAQ

- +


@@ -539,8 +539,8 @@

dstack Enterprise

- Book a demo + class="md-button md-button--primary external small"> + Request a trial
diff --git a/docs/overrides/main.html b/docs/overrides/main.html index 4a74fb3a8a..8db0196109 100644 --- a/docs/overrides/main.html +++ b/docs/overrides/main.html @@ -102,38 +102,42 @@
- - + +
-
Resources
- Documentation - Blog - Changelog -
- -
-
Examples
- Single-node training - Distributed training - Clusters - Inference - - -
- -
-
Company
- Book a demo - - Terms - Privacy - -
-
+
Documentation
+ Getting started + Concepts + Guides + Reference + + +
+
Examples
+ Single-node training + Distributed training + Clusters + Inference +
+ +
+
Community
+ Discord + GitHub +
+ +
+
Company
+ Talk to us + + Terms + Privacy + +
{% endblock %} diff --git a/mkdocs.yml b/mkdocs.yml index e6fac58ed0..2debc121a0 100644 --- a/mkdocs.yml +++ b/mkdocs.yml @@ -67,7 +67,7 @@ plugins: categories_url_format: "{slug}" archive: false categories_name: Blog - categories_sort_reverse: true + # categories_sort_reverse: true - social: cards_layout_options: background_color: "black" @@ -294,6 +294,7 @@ nav: - Tenstorrent: examples/accelerators/tenstorrent/index.md - Benchmarks: blog/benchmarks.md - Case studies: blog/case-studies.md + - Changelog: blog/changelog.md - Blog: - blog/index.md # - Discord: https://discord.gg/u8SmfwPpMd" target="_blank