Commit 4db5765
authored
[Feature]Adapt GLM-5.2 (vllm-project#11264)
### What this PR does / why we need it?
This PR adds support for GLM-5.2 on Ascend. This pull request updates
`model_returns_tuple` in `llm_base_proposer.py` to support
DeepSeek-family MTP models (`DeepSeekMTPModel`). Since DeepSeek MTP
recycles the post-final-norm hidden state, its forward pass returns a
tuple `(logit_hidden, recycle_hidden)`, whereas other MTP families
return a single tensor.
vllm's PR: vllm-project/vllm#45895
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
- vLLM version: v0.23.0
- vLLM main:
vllm-project/vllm@dc68bd8
Signed-off-by: jiajinzhu2 <jiajinzhu@huawei.com>1 parent 2f1c76a commit 4db5765
2 files changed
Lines changed: 14 additions & 2 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
51 | 51 | | |
52 | 52 | | |
53 | 53 | | |
54 | | - | |
55 | | - | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
| 59 | + | |
56 | 60 | | |
57 | 61 | | |
58 | 62 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1557 | 1557 | | |
1558 | 1558 | | |
1559 | 1559 | | |
| 1560 | + | |
| 1561 | + | |
| 1562 | + | |
| 1563 | + | |
| 1564 | + | |
| 1565 | + | |
| 1566 | + | |
| 1567 | + | |
1560 | 1568 | | |
1561 | 1569 | | |
1562 | 1570 | | |
| |||
0 commit comments