You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
### What this PR does / why we need it?
This pull request updates the Mooncake layerwise connector to correctly
calculate and use `remote_transfer_idx` instead of hardcoding `-1` when
indexing `remote_block_ids` for Mamba speculative tokens. This ensures
the correct remote blocks are targeted during KV transfer.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
CI tests.
- vLLM version: v0.23.0
- vLLM main:
vllm-project/vllm@967c5c3
---------
Signed-off-by: nwpu-zxr <zhouxuerong2@huawei.com>
0 commit comments