Commit bdc1523
[Ops][Feature] Add Ascend 310P support for chunk_gated_delta_rule_fwd_h and chunk_fwd_o (vllm-project#9458)
## Summary
- Ports chunk_gated_delta_rule_fwd_h (gated delta rule forward for
DeltaNet/Qwen3) from 910B to 310P
- Ports chunk_fwd_o to 310p
- All 310P changes gated by #ifdef CATLASS_UNIFIED_CORE — 910B code
unchanged
- Unified-core execution path (sequential cube→vector, no AIC/AIV split)
- L0C→UB→GM bridge: BLOCK_MODE_MATRIX + fractal-by-fractal strided
DataCopy (no Fixpipe on 310P)
- CAST_RINT→CAST_NONE for float→half (CAST_RINT silently produces zeros
on 310P)
- DataCopyPad→DataCopy (DataCopyPad unsupported on 310P)
- compat_310p.h: dummy bfloat16_t (310P only), PIPE_FIX→PIPE_MTE3,
LoadDataWithSparse shim
- Preserves original 8 dtype combos (bf16+fp16) for 910B/910C
compatibility
## Test plan
- [x] Precision test via ctypes (test_aclnn_ctypes.py): all outputs
cos>=0.999998 on 310P3
- [x] Python API test (test_npu_chunk_gdr.py): 4 shapes PASS
- [x] ruff check: PASS
- [x] format.sh ci: PASS
<img width="1463" height="541" alt="Screenshot 2026-05-25 at 11 52 28"
src="https://github.com/user-attachments/assets/d56838c7-e81b-4123-afcb-861599c08dae"
/>
- vLLM version: v0.22.1
- vLLM main:
vllm-project/vllm@967c5c3
---------
Signed-off-by: Vladimir Evmenov <evmenoff@Vladimirs-MacBook-Air.local>
Signed-off-by: Vladimir Evmenov <vladimir.evmenov.jr@gmail.com>
Signed-off-by: Tflowers-0129 <2906339855@qq.com>
Co-authored-by: Vladimir Evmenov <evmenoff@Vladimirs-MacBook-Air.local>
Co-authored-by: Tflowers-0129 <2906339855@qq.com>1 parent c45b4ac commit bdc1523
46 files changed
Lines changed: 3851 additions & 37 deletions
File tree
- .github/workflows
- csrc
- moe
- chunk_fwd_o
- op_host
- op_kernel
- arch20
- epilogue
- block
- gemm
- block
- kernel
- arch22
- epilogue
- block
- gemm
- block
- kernel
- chunk_gated_delta_rule_fwd_h
- op_host
- op_kernel
- arch20
- epilogue
- block
- gemm
- block
- kernel
- arch22
- epilogue
- block
- gemm
- block
- kernel
- common/kernel_utils/block
- tests
- e2e/nightly
- 310p/single_node/ops/singlecard_ops
- multi_node/scripts
- ut
- attention/a2
- ops
- worker/a2
- vllm_ascend/_310p/ops/fla
Some content is hidden
Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
124 | 124 | | |
125 | 125 | | |
126 | 126 | | |
| 127 | + | |
127 | 128 | | |
128 | 129 | | |
129 | 130 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
112 | 112 | | |
113 | 113 | | |
114 | 114 | | |
| 115 | + | |
115 | 116 | | |
116 | 117 | | |
117 | 118 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
140 | 140 | | |
141 | 141 | | |
142 | 142 | | |
| 143 | + | |
143 | 144 | | |
144 | 145 | | |
145 | 146 | | |
146 | 147 | | |
147 | 148 | | |
148 | 149 | | |
149 | 150 | | |
| 151 | + | |
150 | 152 | | |
151 | 153 | | |
152 | 154 | | |
153 | 155 | | |
154 | 156 | | |
155 | 157 | | |
156 | 158 | | |
| 159 | + | |
157 | 160 | | |
158 | 161 | | |
159 | 162 | | |
| |||
299 | 302 | | |
300 | 303 | | |
301 | 304 | | |
| 305 | + | |
302 | 306 | | |
303 | 307 | | |
304 | 308 | | |
305 | 309 | | |
306 | 310 | | |
307 | 311 | | |
| 312 | + | |
308 | 313 | | |
309 | 314 | | |
310 | 315 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
110 | 110 | | |
111 | 111 | | |
112 | 112 | | |
| 113 | + | |
113 | 114 | | |
114 | 115 | | |
115 | 116 | | |
| |||
203 | 204 | | |
204 | 205 | | |
205 | 206 | | |
| 207 | + | |
| 208 | + | |
| 209 | + | |
| 210 | + | |
| 211 | + | |
| 212 | + | |
| 213 | + | |
| 214 | + | |
| 215 | + | |
| 216 | + | |
| 217 | + | |
| 218 | + | |
| 219 | + | |
| 220 | + | |
| 221 | + | |
| 222 | + | |
206 | 223 | | |
207 | 224 | | |
208 | 225 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
102 | 102 | | |
103 | 103 | | |
104 | 104 | | |
| 105 | + | |
| 106 | + | |
105 | 107 | | |
106 | 108 | | |
107 | 109 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
49 | 49 | | |
50 | 50 | | |
51 | 51 | | |
| 52 | + | |
| 53 | + | |
52 | 54 | | |
53 | 55 | | |
54 | 56 | | |
55 | 57 | | |
56 | 58 | | |
| 59 | + | |
57 | 60 | | |
58 | 61 | | |
59 | 62 | | |
| |||
99 | 102 | | |
100 | 103 | | |
101 | 104 | | |
| 105 | + | |
| 106 | + | |
102 | 107 | | |
103 | 108 | | |
104 | 109 | | |
105 | 110 | | |
106 | 111 | | |
| 112 | + | |
107 | 113 | | |
108 | 114 | | |
109 | 115 | | |
| |||
183 | 189 | | |
184 | 190 | | |
185 | 191 | | |
| 192 | + | |
| 193 | + | |
186 | 194 | | |
187 | 195 | | |
188 | 196 | | |
189 | 197 | | |
190 | 198 | | |
| 199 | + | |
191 | 200 | | |
192 | 201 | | |
193 | 202 | | |
| |||
261 | 270 | | |
262 | 271 | | |
263 | 272 | | |
| 273 | + | |
| 274 | + | |
264 | 275 | | |
265 | 276 | | |
266 | 277 | | |
267 | 278 | | |
268 | 279 | | |
| 280 | + | |
269 | 281 | | |
270 | 282 | | |
271 | 283 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
57 | 57 | | |
58 | 58 | | |
59 | 59 | | |
| 60 | + | |
| 61 | + | |
60 | 62 | | |
61 | 63 | | |
62 | 64 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
96 | 96 | | |
97 | 97 | | |
98 | 98 | | |
| 99 | + | |
99 | 100 | | |
100 | 101 | | |
101 | 102 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
0 commit comments