Commit ee2a613
authored
[BugFix] ignore recompute scheduler on prefill nodes (vllm-project#11537)
### What this PR does / why we need it?
This PR keeps existing P/D launch scripts working when
`recompute_scheduler_enable=true` is still configured on PD prefill
nodes.
Previously, enabling `recompute_scheduler_enable` outside PD decode
nodes caused startup to fail. This was correct for preventing the
recompute scheduler from running on P nodes, but it was not smooth for
users who still use older launch scripts that set the option on both P
and D nodes.
This PR changes the PD prefill behavior to emit a warning and disable
`recompute_scheduler_enable` on `kv_role='kv_producer'` nodes instead of
failing startup. The recompute scheduler is still initialized only on PD
decode nodes with `kv_role='kv_consumer'`.
Hard errors are retained for PD-mixed or non-PD configurations, and
hybrid Mamba cache lookup is guarded from producer-side recompute
scheduler use.
### Does this PR introduce _any_ user-facing change?
Yes. If `recompute_scheduler_enable=true` is configured on a PD prefill
node, startup no longer fails immediately. The option is ignored on the
P node with a warning, and users should remove it from P-node configs
because it will be deprecated there.
### How was this patch tested?
- vLLM version: v0.23.0
- vLLM main:
vllm-project/vllm@1f486d9
Signed-off-by: y00958240 <yuantao51@huawei.com>1 parent 9872bb9 commit ee2a613
3 files changed
Lines changed: 26 additions & 11 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
561 | 561 | | |
562 | 562 | | |
563 | 563 | | |
564 | | - | |
| 564 | + | |
565 | 565 | | |
566 | 566 | | |
567 | 567 | | |
568 | 568 | | |
| 569 | + | |
569 | 570 | | |
570 | 571 | | |
571 | 572 | | |
572 | 573 | | |
573 | 574 | | |
574 | 575 | | |
575 | 576 | | |
576 | | - | |
| 577 | + | |
| 578 | + | |
577 | 579 | | |
578 | 580 | | |
579 | 581 | | |
| |||
582 | 584 | | |
583 | 585 | | |
584 | 586 | | |
585 | | - | |
586 | | - | |
587 | | - | |
588 | | - | |
589 | 587 | | |
590 | 588 | | |
| 589 | + | |
591 | 590 | | |
592 | 591 | | |
593 | 592 | | |
594 | 593 | | |
| 594 | + | |
| 595 | + | |
| 596 | + | |
| 597 | + | |
| 598 | + | |
| 599 | + | |
| 600 | + | |
595 | 601 | | |
596 | 602 | | |
597 | 603 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
484 | 484 | | |
485 | 485 | | |
486 | 486 | | |
| 487 | + | |
487 | 488 | | |
488 | 489 | | |
489 | 490 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
648 | 648 | | |
649 | 649 | | |
650 | 650 | | |
651 | | - | |
| 651 | + | |
| 652 | + | |
| 653 | + | |
| 654 | + | |
| 655 | + | |
| 656 | + | |
| 657 | + | |
| 658 | + | |
| 659 | + | |
652 | 660 | | |
653 | 661 | | |
654 | 662 | | |
655 | 663 | | |
| 664 | + | |
| 665 | + | |
656 | 666 | | |
657 | | - | |
658 | | - | |
659 | | - | |
660 | | - | |
| 667 | + | |
| 668 | + | |
661 | 669 | | |
662 | 670 | | |
663 | 671 | | |
| |||
0 commit comments