Commit ec1f3f7
authored
[BugFix][KV_Offload] RecomputeCpuOffloadConnector add main2main for releases/v0.23.0 (vllm-project#11061)
### What this PR does / why we need it?
In vllm v0.23.0, a new method `resolve_kv_cache_block_sizes` is
introduced to get `scheduler_block_size` and `hash_block_size`, which
will be used for `get_kv_cache_coordinator`, this PR keep main2mian with
v0.23.0 for `RecomputeCPUOffloadConnector`.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
By CI.
- vLLM version: v0.23.0
- vLLM main:
vllm-project/vllm@967c5c3
Signed-off-by: nwpu-zxr <zhouxuerong2@huawei.com>1 parent 55b8cd0 commit ec1f3f7
1 file changed
Lines changed: 4 additions & 1 deletion
Lines changed: 4 additions & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
16 | 16 | | |
17 | 17 | | |
18 | 18 | | |
| 19 | + | |
19 | 20 | | |
20 | 21 | | |
21 | 22 | | |
| |||
86 | 87 | | |
87 | 88 | | |
88 | 89 | | |
| 90 | + | |
89 | 91 | | |
90 | 92 | | |
91 | 93 | | |
| |||
95 | 97 | | |
96 | 98 | | |
97 | 99 | | |
98 | | - | |
| 100 | + | |
| 101 | + | |
99 | 102 | | |
100 | 103 | | |
101 | 104 | | |
| |||
0 commit comments