Commit f302cf7
authored
[CI] Modify accuracy threshold for aime2025 dataset to 10 (vllm-project#10881)
### What this PR does / why we need it?
This PR modifies the accuracy threshold of the `aime2025` dataset from 5
to 10 across multiple model configurations (GLM5_1, Kimi-K2.5,
MiniMax-M2.5, and Qwen3.5) to accommodate variance in accuracy
benchmarks.
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
Tested via nightly CI pipelines with the updated configuration files.
- vLLM version: v0.23.0
- vLLM main:
vllm-project/vllm@967c5c3
---------
Signed-off-by: chen-commits <1636718796@qq.com>
Signed-off-by: chen <1636718796@qq.com>1 parent a08abea commit f302cf7
4 files changed
Lines changed: 5 additions & 3 deletions
File tree
- tests/e2e/nightly
- multi_node/internal_dp/config
- single_node/models/configs
Lines changed: 2 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
41 | 41 | | |
42 | 42 | | |
43 | 43 | | |
| 44 | + | |
44 | 45 | | |
45 | 46 | | |
46 | 47 | | |
| |||
86 | 87 | | |
87 | 88 | | |
88 | 89 | | |
| 90 | + | |
89 | 91 | | |
90 | 92 | | |
91 | 93 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
63 | 63 | | |
64 | 64 | | |
65 | 65 | | |
66 | | - | |
| 66 | + | |
67 | 67 | | |
68 | 68 | | |
69 | 69 | | |
| |||
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
51 | 51 | | |
52 | 52 | | |
53 | 53 | | |
54 | | - | |
| 54 | + | |
55 | 55 | | |
56 | 56 | | |
57 | 57 | | |
| |||
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
57 | 57 | | |
58 | 58 | | |
59 | 59 | | |
60 | | - | |
| 60 | + | |
61 | 61 | | |
62 | 62 | | |
63 | 63 | | |
| |||
0 commit comments