Skip to content

Commit 2786a8a

Browse files
authored
[Doc][BugFix] Fix Qwen3-VL-Embedding and Reranker user guides (vllm-project#12805)
### What this PR does / why we need it? This PR fixes several issues in the user guides for Qwen3-Reranker, Qwen3-VL-Embedding, and Qwen3-VL-Reranker: - Corrects the model name in the download links for the 8B versions of Qwen3-VL-Embedding and Qwen3-VL-Reranker. - Fixes the model name in the `vllm serve` command for Qwen3-Reranker. - Updates the model cache paths to `/root/.cache/` to match the recommended directory. - Fixes a typo in the benchmark command (`--prot` to `--port`). ### Does this PR introduce _any_ user-facing change? No, this is a documentation-only update. ### How was this patch tested? Documentation changes only, no functional code changes. - vLLM version: v0.25.1 - vLLM main: vllm-project/vllm@fe784ff Signed-off-by: wangyongjun <wangyongjun7@huawei.com>
1 parent 81d3450 commit 2786a8a

3 files changed

Lines changed: 6 additions & 6 deletions

File tree

docs/source/tutorials/models/Qwen3-Reranker.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -117,7 +117,7 @@ If you want to deploy multi-node environment, you need to set up environment on
117117

118118
```shell
119119
#!/bin/sh
120-
vllm serve Qwen/Qwen3-VL-Reranker-2B \
120+
vllm serve Qwen/Qwen3-Reranker-0.6B \
121121
--served-model-name Qwen/Qwen3-Reranker-0.6B \
122122
--runner pooling \
123123
--hf_overrides '{"architectures": ["Qwen3VLForSequenceClassification"],"classifier_from_token": ["no", "yes"],"is_original_qwen3_reranker": true}' \
@@ -251,7 +251,7 @@ Here are two accuracy evaluation methods.
251251
os.environ["HF_DATASETS_CACHE"] = data_path
252252
os.environ["HF_ENDPOINT"] = "https://hf-mirror.com"
253253

254-
model = VllmCrossEncoderWrapper(f"/home/data/Qwen3-Reranker-0.6B",
254+
model = VllmCrossEncoderWrapper(f"/root/.cache/Qwen3-Reranker-0.6B",
255255
revision="norm",
256256
dtype="float16",
257257
enforce_eager=True,
@@ -281,7 +281,7 @@ Refer to [vllm benchmark](https://docs.vllm.ai/en/latest/benchmarking/cli/) for
281281
Take the `serve` as an example. Run the code as follows.
282282

283283
```bash
284-
vllm bench serve --model Qwen/Qwen3-Reranker-0.6B --backend vllm-rerank --prot 8000 --dataset-name random-rerank --endpoint /v1/rerank --random-input 200 --save-result --result-dir ./
284+
vllm bench serve --model Qwen/Qwen3-Reranker-0.6B --backend vllm-rerank --port 8000 --dataset-name random-rerank --endpoint /v1/rerank --random-input 200 --save-result --result-dir ./
285285
```
286286

287287
After about several minutes, you can get the performance evaluation result.

docs/source/tutorials/models/Qwen3-VL-Embedding.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,7 @@ Refer to [supported features](../../user_guide/support_matrix/supported_models.m
1212

1313
### 3.1 Model Weight
1414

15-
- `Qwen3-VL-Embedding-2B` [Download model weight](https://www.modelscope.cn/models/Qwen/Qwen3-VL-Embedding-8B)
15+
- `Qwen3-VL-Embedding-8B` [Download model weight](https://www.modelscope.cn/models/Qwen/Qwen3-VL-Embedding-8B)
1616
- `Qwen3-VL-Embedding-2B` [Download model weight](https://www.modelscope.cn/models/Qwen/Qwen3-VL-Embedding-2B)
1717

1818
It is recommended to download the model weight to the shared directory of multiple nodes, such as `/root/.cache/`

docs/source/tutorials/models/Qwen3-VL-Reranker.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,7 @@ Refer to [supported features](../../user_guide/support_matrix/supported_models.m
1212

1313
### 3.1 Model Weight
1414

15-
- `Qwen3-VL-Reranker-2B` [Download model weight](https://www.modelscope.cn/models/Qwen/Qwen3-VL-Reranker-8B)
15+
- `Qwen3-VL-Reranker-8B` [Download model weight](https://www.modelscope.cn/models/Qwen/Qwen3-VL-Reranker-8B)
1616
- `Qwen3-VL-Reranker-2B` [Download model weight](https://www.modelscope.cn/models/Qwen/Qwen3-VL-Reranker-2B)
1717

1818
It is recommended to download the model weight to the shared directory of multiple nodes, such as `/root/.cache/`
@@ -255,7 +255,7 @@ Here are two accuracy evaluation methods.
255255
os.environ["HF_DATASETS_CACHE"] = data_path
256256
os.environ["HF_ENDPOINT"] = "https://hf-mirror.com"
257257

258-
model = VllmCrossEncoderWrapper(f"/home/data/Qwen3-VL-Reranker-2B",
258+
model = VllmCrossEncoderWrapper(f"/root/.cache/Qwen3-VL-Reranker-2B",
259259
revision="norm",
260260
dtype="float16",
261261
enforce_eager=True,

0 commit comments

Comments
 (0)