Commit b6fe31d
authored
[BugFix][main] remove unnecessary lazy_init for memcache backend (vllm-project#13029)
Cherry-pick of PR vllm-project#13028 to main branch.
`lazy_init` is only needed for mooncake backend with deepseekv4 compress
model on A3 hardware. The memcache backend handles lazy initialization
internally based on device type, so passing `lazy_init=True` from
`pool_worker` is redundant.
- vLLM version: v0.25.1
- vLLM main:
vllm-project/vllm@d02df74
---------
Signed-off-by: tyy0829 <1455207791@qq.com>1 parent 2138260 commit b6fe31d
1 file changed
Lines changed: 9 additions & 13 deletions
Lines changed: 9 additions & 13 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
300 | 300 | | |
301 | 301 | | |
302 | 302 | | |
303 | | - | |
304 | | - | |
305 | | - | |
306 | | - | |
307 | | - | |
308 | | - | |
309 | | - | |
310 | | - | |
311 | | - | |
312 | | - | |
313 | | - | |
314 | | - | |
315 | | - | |
| 303 | + | |
| 304 | + | |
| 305 | + | |
| 306 | + | |
| 307 | + | |
| 308 | + | |
| 309 | + | |
| 310 | + | |
| 311 | + | |
316 | 312 | | |
317 | 313 | | |
318 | 314 | | |
| |||
0 commit comments