Commit d40b187
authored
[BugFix][Ops] chunk_scaled_dot_kkt_fwd_kernel recompile issues (vllm-project#11577)
### What this PR does / why we need it?
This PR fixes recompilation issues in the
`chunk_scaled_dot_kkt_fwd_kernel` Triton kernel. The parameters
`bh_step`, `task_num`, and `num_core` were previously defined as
`tl.constexpr`, which caused Triton to recompile the kernel whenever
these values changed. By changing them to regular arguments, we avoid
recompilation when these values change.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
- vLLM version: v0.23.0
- vLLM main:
vllm-project/vllm@1f486d9
---------
Signed-off-by: Ascendyh <hw7osiris@outlook.com>1 parent 0532c49 commit d40b187
1 file changed
Lines changed: 4 additions & 4 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
23 | 23 | | |
24 | 24 | | |
25 | 25 | | |
26 | | - | |
| 26 | + | |
27 | 27 | | |
28 | 28 | | |
29 | 29 | | |
| |||
33 | 33 | | |
34 | 34 | | |
35 | 35 | | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
36 | 39 | | |
37 | 40 | | |
38 | 41 | | |
39 | 42 | | |
40 | 43 | | |
41 | 44 | | |
42 | 45 | | |
43 | | - | |
44 | | - | |
45 | | - | |
46 | 46 | | |
47 | 47 | | |
48 | 48 | | |
| |||
0 commit comments