Skip to content

Commit 04ad252

Browse files
authored
[Doc][Misc] Fix Docker image tags and add A3/A2 tab-set for Qwen3 tutorials (vllm-project#11239)
### What this PR does / why we need it? Fixes Docker image tags in Qwen3-30B-A3B and Qwen3-Coder-30B-A3B tutorials: - Wraps Docker Pull and Docker Run commands in tab-set (A3/A2) for clarity - Adds `-a3` suffix to A3 image tags (e.g., `vllm-ascend:v0.22.1rc-a3`) - Removes YaRN from Coder Long Context table (Coder natively supports 256K context) Follow-up to vllm-project#10148. - vLLM version: v0.23.0 - vLLM main: vllm-project/vllm@dc68bd8 Signed-off-by: xuchi <xuchicolson@163.com>
1 parent e928441 commit 04ad252

2 files changed

Lines changed: 43 additions & 19 deletions

File tree

docs/source/tutorials/models/Qwen3-30B-A3B.md

Lines changed: 21 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -46,24 +46,26 @@ Qwen3-30B-A3B-W8A8 adopts a hybrid quantization strategy (ordered by model struc
4646

4747
You can use the official all-in-one Docker image for Qwen3 MoE models.
4848

49-
**Docker Pull:**
50-
51-
```bash
52-
docker pull quay.io/ascend/vllm-ascend:|vllm_ascend_version|
53-
```
54-
55-
**Docker Run:**
56-
5749
:::::{tab-set}
5850
:sync-group: hardware
5951

6052
::::{tab-item} Atlas 800I A3
6153
:sync: a3
6254

55+
**Docker Pull:**
56+
6357
```{code-block} bash
6458
:substitutions:
6559
66-
export IMAGE=quay.io/ascend/vllm-ascend:|vllm_ascend_version|
60+
docker pull quay.io/ascend/vllm-ascend:|vllm_ascend_version|-a3
61+
```
62+
63+
**Docker Run:**
64+
65+
```{code-block} bash
66+
:substitutions:
67+
68+
export IMAGE=quay.io/ascend/vllm-ascend:|vllm_ascend_version|-a3
6769
6870
docker run \
6971
--name vllm-ascend-env \
@@ -113,6 +115,16 @@ If you are on a shared machine, map only the chips you need (e.g., `/dev/davinci
113115
::::{tab-item} Atlas 800I A2
114116
:sync: a2
115117

118+
**Docker Pull:**
119+
120+
```{code-block} bash
121+
:substitutions:
122+
123+
docker pull quay.io/ascend/vllm-ascend:|vllm_ascend_version|
124+
```
125+
126+
**Docker Run:**
127+
116128
```{code-block} bash
117129
:substitutions:
118130

docs/source/tutorials/models/Qwen3-Coder-30B-A3B.md

Lines changed: 22 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -46,24 +46,26 @@ Qwen3-Coder-30B-A3B-W8A8 adopts a hybrid quantization strategy (ordered by model
4646

4747
You can use the official all-in-one Docker image for Qwen3 MoE models.
4848

49-
**Docker Pull:**
50-
51-
```bash
52-
docker pull quay.io/ascend/vllm-ascend:|vllm_ascend_version|
53-
```
54-
55-
**Docker Run:**
56-
5749
:::::{tab-set}
5850
:sync-group: hardware
5951

6052
::::{tab-item} Atlas 800I A3
6153
:sync: a3
6254

55+
**Docker Pull:**
56+
6357
```{code-block} bash
6458
:substitutions:
6559
66-
export IMAGE=quay.io/ascend/vllm-ascend:|vllm_ascend_version|
60+
docker pull quay.io/ascend/vllm-ascend:|vllm_ascend_version|-a3
61+
```
62+
63+
**Docker Run:**
64+
65+
```{code-block} bash
66+
:substitutions:
67+
68+
export IMAGE=quay.io/ascend/vllm-ascend:|vllm_ascend_version|-a3
6769
6870
docker run \
6971
--name vllm-ascend-env \
@@ -113,6 +115,16 @@ If you are on a shared machine, map only the chips you need (e.g., `/dev/davinci
113115
::::{tab-item} Atlas 800I A2
114116
:sync: a2
115117

118+
**Docker Pull:**
119+
120+
```{code-block} bash
121+
:substitutions:
122+
123+
docker pull quay.io/ascend/vllm-ascend:|vllm_ascend_version|
124+
```
125+
126+
**Docker Run:**
127+
116128
```{code-block} bash
117129
:substitutions:
118130
@@ -470,7 +482,7 @@ vllm bench serve \
470482
| --------------- | ------ | --- | ------------- | ------------ | --------- | --- | ------------ |
471483
| High Throughput | 1 (A3) | 1 | 37364 | 100 | Off | Off | - |
472484
| Low Latency | 2 (A3) | 4 | 37364 | 100 | Off | On | - |
473-
| Long Context | 2 (A3) | 4 | 131072 | 14 | Off | On | YaRN |
485+
| Long Context | 2 (A3) | 4 | 131072 | 14 | Off | On | - |
474486

475487
> For detailed parameter descriptions, please refer to the deployment examples in Section 5.
476488

0 commit comments

Comments
 (0)