Add Azure H100 NVL and H200 GPU support#220
Merged
peterschmidt85 merged 2 commits intodstackai:mainfrom Mar 26, 2026
Merged
Conversation
Contributor
|
The test errors above are fixed by #221 |
- Add NC H100 v5-series (Standard_NC40ads_H100_v5, Standard_NC80adis_H100_v5) with correct 94GB VRAM for H100 NVL GPUs - Add ND H200 v5-series (Standard_ND96isr_H200_v5) with 141GB VRAM - Update both gpu_vm_series and filter() method Fixes dstackai#101
peterschmidt85
force-pushed
the
feature/azure-h100-h200-support
branch
from
b4798b9 to
ec36633
Compare
Contributor
|
@EzgiTastan also, did you have a chance to test the updated version of |
Contributor
|
@EzgiTastan In order to try it with |
Contributor
|
The gpuhunt side looks good, but dstack won't show H100/H200 offers because of Add these two patterns: r"NC(\d+)adi?s_H100_v5", # NC H100 v5-series [H100 NVL 94GB]
r"ND(\d+)isr_H200_v5", # ND H200 v5-series [8xH200 141GB]To test end-to-end: GPUHUNT_CATALOG_DIR=~/gpuhunt uv run dstack server
uv run dstack offer -b azure --gpu H100NVL
uv run dstack offer -b azure --gpu H200 |
This comment was marked as resolved.
This comment was marked as resolved.
peterschmidt85
pushed a commit
that referenced
this pull request
Mar 26, 2026
Add H100NVL and H200 to expected GPU names in test_gpu_presented following the addition of these VM series in #220. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
1 task
peterschmidt85
added a commit
that referenced
this pull request
Mar 26, 2026
Add H100NVL and H200 to expected GPU names in test_gpu_presented following the addition of these VM series in #220. Co-authored-by: Andrey Cheptsov <andrey.cheptsov@github.com> Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Add support for Azure H100 NVL and H200 GPU virtual machines.
Changes
NC H100 v5-series:
Standard_NC40ads_H100_v5(1x H100 NVL, 94GB)Standard_NC80adis_H100_v5(2x H100 NVL, 94GB each)NC(\d+)adi?s_H100_v5— theiis optional (present only in NC80 for isolated instances)ND H200 v5-series:
Standard_ND96isr_H200_v5(8x H200, 141GB each)ND(\d+)isr_H200_v5Correction to #101
The original suggestion used 80GB VRAM, but the H100 NVL has 94GB per GPU. The pattern also needed
i?to match both NC40 (noi) and NC80 (hasi).References
Fixes #101