Skip to content

Commit 8b39f17

Browse files
authored
[Doc] Remove redundant async-scheduling config. (vllm-project#13093)
### What this PR does / why we need it? This PR removes the redundant `--async-scheduling` configuration option from various model deployment tutorials and translation files. ### Does this PR introduce _any_ user-facing change? No. This is a documentation cleanup only. ### How was this patch tested? Documentation changes only, verified manually. - vLLM version: v0.25.1 - vLLM main: vllm-project/vllm@d02df74 Signed-off-by: zhiyu-wa <1959864813@qq.com>
1 parent c6c8420 commit 8b39f17

22 files changed

Lines changed: 7 additions & 106 deletions

docs/source/_templates/Model-Deployment-Tutorial-Template.zh.md

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -275,7 +275,6 @@ lm_eval \
275275
| --------- | --------- | --------- | --------- | --------- |
276276
| FlashComm_v1 | 大并发、张量并行(TP)场景 | `export VLLM_ASCEND_ENABLE_FLASHCOMM1=1` | 将传统Allreduce分解为Reduce-Scatter和All-Gather,减少RMSNorm计算维度 | 阈值保护:仅当实际token数超过阈值时生效,避免小并发场景性能倒退|
277277
| Matmul-ReduceScatter融合 | 大型分布式环境 | 启用FlashComm_v1后自动开启 | 将矩阵乘法与Reduce-Scatter操作融合,实现流水线并行处理 | 同FlashComm_v1,有阈值保护 |
278-
| 异步调度 | 大规模模型、高并发场景 | `--async-scheduling` | 非阻塞任务调度,提升并发处理能力 | 与FullGraph优化协同使用 |
279278

280279
## 10 FAQ
281280

docs/source/locale/zh_CN/LC_MESSAGES/tutorials/models/DeepSeek-V4-Flash.po

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -169,14 +169,12 @@ msgid ""
169169
"- `--no-enable-prefix-caching` indicates that prefix caching is disabled. To enable it, remove this option.\n"
170170
"- `--speculative-config` configures the MTP (Multi-Token Prediction) speculative decoding to accelerate inference.\n"
171171
"- `--compilation-config '{\"cudagraph_mode\":\"FULL_DECODE_ONLY\"}'` enables full ACL graph execution in the decode phase to reduce scheduling latency.\n"
172-
"- `--async-scheduling` enables asynchronous scheduling to overlap CPU scheduling with NPU computation.\n"
173172
"- `VLLM_ASCEND_ENABLE_FLASHCOMM1=1` enables the FlashComm communication optimization."
174173
msgstr ""
175174
"- `--max-model-len` 指定最大上下文长度,即单个请求的输入和输出 token 之和。请根据实际场景调整。\n"
176175
"- `--no-enable-prefix-caching` 表示禁用前缀缓存。如需启用,请移除该选项。\n"
177176
"- `--speculative-config` 配置 MTP(多 token 预测)推测解码以加速推理。\n"
178177
"- `--compilation-config '{\"cudagraph_mode\":\"FULL_DECODE_ONLY\"}'` 在解码阶段启用全 ACL 图执行,以减少调度延迟。\n"
179-
"- `--async-scheduling` 启用异步调度,使 CPU 调度与 NPU 计算重叠。\n"
180178
"- `VLLM_ASCEND_ENABLE_FLASHCOMM1=1` 启用 FlashComm 通信优化。"
181179

182180
msgid ""

docs/source/locale/zh_CN/LC_MESSAGES/tutorials/models/DeepSeek-V4-Pro.po

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -182,7 +182,6 @@ msgid ""
182182
"- `--max-model-len` specifies the maximum context length. Adjust it according to your actual scenario.\n"
183183
"- `--speculative-config` configures the MTP (Multi-Token Prediction) speculative decoding to accelerate inference.\n"
184184
"- `--compilation-config '{\"cudagraph_mode\":\"FULL_DECODE_ONLY\"}'` enables full ACL graph execution in the decode phase to reduce scheduling latency.\n"
185-
"- `--async-scheduling` enables asynchronous scheduling to overlap CPU scheduling with NPU computation.\n"
186185
"- `VLLM_ASCEND_ENABLE_FLASHCOMM1=1` enables the FlashComm communication optimization."
187186
msgstr ""
188187
"- `--data-parallel-start-rank` 指定当前节点的数据并行起始 rank。每个节点必须设置为唯一值(例如,节点0 = 0,节点1 = 1)。\n"
@@ -191,7 +190,6 @@ msgstr ""
191190
"- `--max-model-len` 指定最大上下文长度。请根据实际场景进行调整。\n"
192191
"- `--speculative-config` 配置 MTP(多 Token 预测)推测解码以加速推理。\n"
193192
"- `--compilation-config '{\"cudagraph_mode\":\"FULL_DECODE_ONLY\"}'` 在解码阶段启用完整的 ACL 图执行,以减少调度延迟。\n"
194-
"- `--async-scheduling` 启用异步调度,使 CPU 调度与 NPU 计算重叠。\n"
195193
"- `VLLM_ASCEND_ENABLE_FLASHCOMM1=1` 启用 FlashComm 通信优化。"
196194

197195
msgid ""

docs/source/locale/zh_CN/LC_MESSAGES/tutorials/models/Qwen3-VL-235B-A22B-Instruct.po

Lines changed: 0 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -610,12 +610,6 @@ msgstr ""
610610
"| 前缀缓存 | `--enable-prefix-caching` | 改善重复前缀的工作负载。 | 首先验证 HBM 使用情况。对于 "
611611
"PD,建议从禁用前缀缓存开始。 |"
612612

613-
msgid ""
614-
"| Asynchronous scheduling | `--async-scheduling` | Can improve high-"
615-
"concurrency throughput. | Disable and compare for latency-sensitive "
616-
"workloads. |"
617-
msgstr "| 异步调度 | `--async-scheduling` | 可提高高并发吞吐量。 | 对于延迟敏感的工作负载,请禁用并比较。 |"
618-
619613
msgid ""
620614
"| PD disaggregation | `--kv-transfer-config` | Separates prefill and decode "
621615
"resources. | Ensure producer/consumer DP and TP sizes match the actual "

docs/source/locale/zh_CN/LC_MESSAGES/tutorials/models/Qwen3-VL-30B-A3B-Instruct.po

Lines changed: 0 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -442,12 +442,6 @@ msgid ""
442442
msgstr ""
443443
"| 前缀缓存 | `--enable-prefix-caching` | 提升重复前缀工作负载的性能。 | 随机提示或唯一媒体可能无法受益。 |"
444444

445-
msgid ""
446-
"| Asynchronous scheduling | `--async-scheduling` | Can improve high-"
447-
"concurrency throughput. | Disable and compare for latency-sensitive "
448-
"workloads. |"
449-
msgstr "| 异步调度 | `--async-scheduling` | 可提升高并发吞吐量。 | 对于延迟敏感型工作负载,请禁用并进行对比。 |"
450-
451445
msgid ""
452446
"| Pipeline parallel validation | `--pipeline-parallel-size 2` | Provides "
453447
"another two-card validation layout. | Use shorter context and lower batch "

docs/source/locale/zh_CN/LC_MESSAGES/tutorials/models/Qwen3.5-27B-Qwen3.6-27B.po

Lines changed: 2 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -224,10 +224,10 @@ msgstr "PD(Prefill-Decode)分离通过将 Prefill 和 Decode 运行在专用
224224

225225
msgid ""
226226
"- **Prefill nodes** focus on high-throughput prompt processing, optimized for compute and communication (e.g., enabling FlashComm for Allreduce acceleration).\n"
227-
"- **Decode nodes** focus on low-latency token generation, optimized for memory bandwidth (e.g., enabling async-scheduling and full-decode aclgraph)."
227+
"- **Decode nodes** focus on low-latency token generation, optimized for memory bandwidth (e.g., enabling full-decode aclgraph)."
228228
msgstr ""
229229
"- **Prefill节点**专注于高吞吐量的提示处理,针对计算和通信进行了优化(例如,启用FlashComm以加速Allreduce)。\n"
230-
"- **Decode节点**专注于低延迟的令牌生成,针对内存带宽进行了优化(例如,启用异步调度和全解码aclgraph)。"
230+
"- **Decode节点**专注于低延迟的令牌生成,针对内存带宽进行了优化(例如,启用全解码aclgraph)。"
231231

232232
msgid ""
233233
"For `Qwen3.5-27B-w8a8` and `Qwen3.6-27B-w8a8`, a typical **1P1D** "
@@ -299,12 +299,10 @@ msgstr ""
299299
msgid ""
300300
"- `VLLM_ASCEND_ENABLE_FLASHCOMM1=1`: enables the Allreduce communication optimization on prefill nodes, which reduces the communication overhead of long-context prefill.\n"
301301
"- `recompute_scheduler_enable: true`: enables the recomputation scheduler. When the KV Cache of the decode node is insufficient, requests will be sent to the prefill node to recompute the KV Cache. In the PD separation scenario, enable this configuration only on decode nodes.\n"
302-
"- `--async-scheduling` (on decode nodes): enables asynchronous scheduling, which can reduce TPOT for high-concurrency decode workloads.\n"
303302
"- `--compilation-config '{\"cudagraph_mode\":\"FULL_DECODE_ONLY\"}'` (on decode nodes): enables the full-decode aclgraph mode, which significantly reduces scheduling latency on the decode side."
304303
msgstr ""
305304
"- `VLLM_ASCEND_ENABLE_FLASHCOMM1=1`:在prefill节点上启用Allreduce通信优化,减少长上下文prefill的通信开销。\n"
306305
"- `recompute_scheduler_enable: true`:启用重计算调度器。当decode节点的KV缓存不足时,请求将被发送到prefill节点以重新计算KV缓存。在PD分离场景中,仅在decode节点上启用此配置。\n"
307-
"- `--async-scheduling`(在decode节点上):启用异步调度,可以减少高并发解码工作负载的TPOT。\n"
308306
"- `--compilation-config '{\"cudagraph_mode\":\"FULL_DECODE_ONLY\"}'`(在decode节点上):启用全解码aclgraph模式,显著降低解码端的调度延迟。"
309307

310308
msgid "4. Run server for each node:"

docs/source/locale/zh_CN/LC_MESSAGES/tutorials/models/Qwen3.6-35B-A3B.po

Lines changed: 0 additions & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -328,13 +328,6 @@ msgid ""
328328
"shape."
329329
msgstr "**原因:** 异步调度减少了阻塞开销,但其收益取决于并发度、提示/输出长度和图捕获形状。"
330330

331-
msgid ""
332-
"**Solution:** Use `--async-scheduling` for high-throughput serving. For low-"
333-
"latency serving, compare TTFT and TPOT with and without this option."
334-
msgstr ""
335-
"**解决方案:** 对于高吞吐量服务,使用 `--async-scheduling`。对于低延迟服务,请比较启用和未启用此选项时的 TTFT 和 "
336-
"TPOT。"
337-
338331
msgid ""
339332
"| Scenario | Deployment Mode | Total NPUs | Weight Version | Key "
340333
"Considerations |"
@@ -405,13 +398,6 @@ msgstr ""
405398
"| 共享专家重叠 | `--additional-config '{\"multistream_overlap_shared_expert\": "
406399
"true}'` | 在MoE工作负载中重叠共享专家计算。 | 推荐用于吞吐量场景。 |"
407400

408-
msgid ""
409-
"| Asynchronous scheduling | `--async-scheduling` | Improves high-concurrency"
410-
" throughput by using non-blocking scheduling. | Disable it and compare if "
411-
"the workload is latency-sensitive. |"
412-
msgstr ""
413-
"| 异步调度 | `--async-scheduling` | 通过非阻塞调度提高高并发吞吐量。 | 如果工作负载对延迟敏感,请禁用它并进行比较。 |"
414-
415401
msgid ""
416402
"| Prefix caching | `--enable-prefix-caching` | Improves repeated-prefix "
417403
"workloads. | Monitor HBM usage for long-context workloads. |"
@@ -495,7 +481,6 @@ msgid ""
495481
" - `--quantization ascend` enables Ascend quantization for the W8A8 model. Remove this option when deploying the BF16 model.\n"
496482
" - `--compilation-config '{\"cudagraph_mode\":\"FULL_DECODE_ONLY\"}'` enables full decode ACLGraph replay to reduce dispatch overhead.\n"
497483
" - `--additional-config` enables Ascend-specific optimizations. `enable_flashcomm1` enables FlashComm1, `multistream_overlap_shared_expert` overlaps shared expert computation, and `enable_cpu_binding` enables Ascend-native CPU binding.\n"
498-
" - `--async-scheduling` enables asynchronous scheduling, which can improve high-concurrency throughput."
499484
msgstr ""
500485
"- `--data-parallel-size 1`和`--tensor-parallel-size 2`为默认的单节点服务示例设置DP和TP。\n"
501486
" - `--enable-expert-parallel`为MoE层启用专家并行。不要在同一个MoE层中混合使用MoE张量并行和专家并行。\n"
@@ -507,7 +492,6 @@ msgstr ""
507492
" - `--quantization ascend`为W8A8模型启用Ascend量化。部署BF16模型时请移除该选项。\n"
508493
" - `--compilation-config '{\"cudagraph_mode\":\"FULL_DECODE_ONLY\"}'`启用全解码ACLGraph重放以减少调度开销。\n"
509494
" - `--additional-config`启用Ascend特定优化。`enable_flashcomm1`启用FlashComm1,`multistream_overlap_shared_expert`重叠共享专家计算,`enable_cpu_binding`启用Ascend原生CPU绑定。\n"
510-
" - `--async-scheduling`启用异步调度,可以提高高并发吞吐量。"
511495

512496
msgid ""
513497
"- `--tensor-parallel-size 2` maps the model across two Atlas inference devices. Adjust it together with `ASCEND_RT_VISIBLE_DEVICES` according to the available devices and memory.\n"

docs/source/tutorials/models/DeepSeek-V4-Flash.md

Lines changed: 0 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -174,7 +174,6 @@ Single-node deployment completes both Prefill and Decode within the same node. T
174174
--block-size 128 \
175175
--speculative-config '{"num_speculative_tokens": 1,"method": "mtp","enforce_eager": true}' \
176176
--compilation-config '{"cudagraph_mode": "FULL_DECODE_ONLY"}' \
177-
--async-scheduling \
178177
--additional-config '
179178
{"ascend_compilation_config":{
180179
"enable_npugraph_ex":true,
@@ -255,7 +254,6 @@ Single-node deployment completes both Prefill and Decode within the same node. T
255254
--block-size 128 \
256255
--speculative-config '{"num_speculative_tokens": 1,"method": "mtp","enforce_eager": true}' \
257256
--compilation-config '{"cudagraph_mode": "FULL_DECODE_ONLY"}' \
258-
--async-scheduling \
259257
--additional-config '
260258
{"ascend_compilation_config":{
261259
"enable_npugraph_ex":true,
@@ -271,7 +269,6 @@ Key Parameter Descriptions:
271269
- `--no-enable-prefix-caching` indicates that prefix caching is disabled. To enable it, remove this option.
272270
- `--speculative-config` configures the MTP (Multi-Token Prediction) speculative decoding to accelerate inference.
273271
- `--compilation-config '{"cudagraph_mode":"FULL_DECODE_ONLY"}'` enables full ACL graph execution in the decode phase to reduce scheduling latency.
274-
- `--async-scheduling` enables asynchronous scheduling to overlap CPU scheduling with NPU computation.
275272
- `VLLM_ASCEND_ENABLE_FLASHCOMM1=1` enables the FlashComm communication optimization.
276273

277274
Common Issues Tip: If you encounter issues, please refer to the [Public FAQ](https://docs.vllm.ai/projects/ascend/en/latest/faqs.html) for troubleshooting.
@@ -541,7 +538,6 @@ Before you start, please:
541538
--max-model-len 1048576 \
542539
--max-num-batched-tokens 120 \
543540
--max-num-seqs 60 \
544-
--async-scheduling \
545541
--block-size 128 \
546542
--no-disable-hybrid-kv-cache-manager \
547543
--no-enable-prefix-caching \
@@ -725,7 +721,6 @@ Before you start, please:
725721
--max-num-seqs 16 \
726722
--block-size 128 \
727723
--enforce-eager \
728-
--async-scheduling \
729724
--no-disable-hybrid-kv-cache-manager \
730725
--enable-prefix-caching \
731726
--trust-remote-code \
@@ -801,7 +796,6 @@ Before you start, please:
801796
--max-model-len 135000 \
802797
--max-num-batched-tokens 60 \
803798
--max-num-seqs 30 \
804-
--async-scheduling \
805799
--block-size 128 \
806800
--no-disable-hybrid-kv-cache-manager \
807801
--no-enable-prefix-caching \

docs/source/tutorials/models/DeepSeek-V4-Pro.md

Lines changed: 0 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -188,7 +188,6 @@ The quantized model `DeepSeek-V4-Pro-w4a8-mtp` requires at least 2 Atlas 800 A3
188188
--tool-call-parser deepseek_v4 \
189189
--enable-auto-tool-choice \
190190
--reasoning-parser deepseek_v4 \
191-
--async-scheduling \
192191
--safetensors-load-strategy 'prefetch' \
193192
--block-size 128 \
194193
--speculative-config '{
@@ -265,7 +264,6 @@ The quantized model `DeepSeek-V4-Pro-w4a8-mtp` requires at least 2 Atlas 800 A3
265264
--tool-call-parser deepseek_v4 \
266265
--enable-auto-tool-choice \
267266
--reasoning-parser deepseek_v4 \
268-
--async-scheduling \
269267
--safetensors-load-strategy 'prefetch' \
270268
--block-size 128 \
271269
--headless \
@@ -336,7 +334,6 @@ The quantized model `DeepSeek-V4-Pro-w4a8-mtp` requires at least 2 Atlas 800 A3
336334
--port 8900 \
337335
--host 0.0.0.0 \
338336
--block-size 128 \
339-
--async-scheduling \
340337
--compilation-config '{"cudagraph_mode":"FULL_DECODE_ONLY"}' \
341338
--tokenizer-mode deepseek_v4 \
342339
--tool-call-parser deepseek_v4 \
@@ -395,7 +392,6 @@ The quantized model `DeepSeek-V4-Pro-w4a8-mtp` requires at least 2 Atlas 800 A3
395392
--port 8900 \
396393
--host 0.0.0.0 \
397394
--block-size 128 \
398-
--async-scheduling \
399395
--compilation-config '{"cudagraph_mode":"FULL_DECODE_ONLY"}' \
400396
--tokenizer-mode deepseek_v4 \
401397
--tool-call-parser deepseek_v4 \
@@ -419,7 +415,6 @@ Key Parameter Descriptions:
419415
- `--max-model-len` specifies the maximum context length. Adjust it according to your actual scenario.
420416
- `--speculative-config` configures the MTP (Multi-Token Prediction) speculative decoding to accelerate inference.
421417
- `--compilation-config '{"cudagraph_mode":"FULL_DECODE_ONLY"}'` enables full ACL graph execution in the decode phase to reduce scheduling latency.
422-
- `--async-scheduling` enables asynchronous scheduling to overlap CPU scheduling with NPU computation.
423418
- `VLLM_ASCEND_ENABLE_FLASHCOMM1=1` enables the FlashComm communication optimization.
424419

425420
Common Issues Tip: If you encounter issues, please refer to the [Public FAQ](https://docs.vllm.ai/projects/ascend/en/latest/faqs.html) for troubleshooting.
@@ -755,7 +750,6 @@ Before you start, please:
755750
--max-model-len 131072 \
756751
--max-num-batched-tokens 120 \
757752
--max-num-seqs 60 \
758-
--async-scheduling \
759753
--block-size 128 \
760754
--no-enable-prefix-caching \
761755
--tokenizer-mode deepseek_v4 \
@@ -1061,7 +1055,6 @@ Before you start, please:
10611055
--max-model-len 133072 \
10621056
--max-num-batched-tokens 120 \
10631057
--max-num-seqs 60 \
1064-
--async-scheduling \
10651058
--block-size 128 \
10661059
--no-disable-hybrid-kv-cache-manager \
10671060
--trust-remote-code \

docs/source/tutorials/models/GLM5.2.md

Lines changed: 0 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -315,7 +315,6 @@ If you want to deploy multi-node environment, you need to verify multi-node comm
315315
--port 7000 \
316316
--safetensors-load-strategy 'prefetch' \
317317
--block-size 128 \
318-
--async-scheduling \
319318
--additional-config '{"multistream_overlap_shared_expert": true}' \
320319
--compilation-config '{"cudagraph_mode": "FULL_DECODE_ONLY"}' \
321320
--speculative-config '{"num_speculative_tokens": 5, "method": "deepseek_mtp", "enforce_eager": true}'
@@ -372,7 +371,6 @@ If you want to deploy multi-node environment, you need to verify multi-node comm
372371
--port 7000 \
373372
--safetensors-load-strategy 'prefetch' \
374373
--block-size 128 \
375-
--async-scheduling \
376374
--additional-config '{"multistream_overlap_shared_expert": true}' \
377375
--compilation-config '{"cudagraph_mode": "FULL_DECODE_ONLY"}' \
378376
--speculative-config '{"num_speculative_tokens": 5, "method": "deepseek_mtp", "enforce_eager": true}'
@@ -675,7 +673,6 @@ Before you start, please
675673
--trust-remote-code \
676674
--max-num-seqs 32 \
677675
--gpu-memory-utilization 0.92 \
678-
--async-scheduling \
679676
--quantization ascend \
680677
--enable-auto-tool-choice \
681678
--tool-call-parser glm47 \
@@ -744,7 +741,6 @@ Before you start, please
744741
--trust-remote-code \
745742
--max-num-seqs 32 \
746743
--gpu-memory-utilization 0.92 \
747-
--async-scheduling \
748744
--quantization ascend \
749745
--enable-auto-tool-choice \
750746
--tool-call-parser glm47 \
@@ -900,7 +896,6 @@ vllm serve /root/.cache/modelscope/hub/models/vllm-ascend/GLM-5.2-w4a8c8 \
900896
--seed 1024 \
901897
--enable-chunked-prefill \
902898
--served-model-name glm-5 \
903-
--async-scheduling \
904899
--max-model-len 256000 \
905900
--max-num-batched-tokens 8192 \
906901
--trust-remote-code \
@@ -1004,7 +999,6 @@ vllm serve /root/.cache/modelscope/hub/models/vllm-ascend/GLM-5.2-w4a8c8 \
1004999
--enable-prefix-caching \
10051000
--seed 1024 \
10061001
--served-model-name glm-5 \
1007-
--async-scheduling \
10081002
--max-model-len 256000 \
10091003
--max-num-batched-tokens 256 \
10101004
--trust-remote-code \

0 commit comments

Comments
 (0)