Skip to content

Commit 20c7cb8

Browse files
authored
[Test][Misc] Update MiniMax-M2.5-w8a8 test configuration (vllm-project#12298)
### What this PR does / why we need it? This PR updates the test configuration for the `MiniMax-M2.5-w8a8` model on Ascend NPU. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Tested via nightly single-node E2E tests for MiniMax-M2.5-w8a8. - vLLM version: v0.24.0 - vLLM main: vllm-project/vllm@85c09e9 --------- Signed-off-by: chen-commits <1636718796@qq.com> Signed-off-by: chen <1636718796@qq.com>
1 parent 405669d commit 20c7cb8

2 files changed

Lines changed: 13 additions & 14 deletions

File tree

.github/workflows/configs/nightly_config.yaml

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -32,6 +32,9 @@ a2:
3232
- name: gemma4-31b-dense
3333
os: linux-aarch64-a2b3-4
3434
config_file_path: Gemma4-31B-Dense.yaml
35+
- name: MiniMax-M2.5-w8a8-QuaRot-A2
36+
os: linux-aarch64-a2b3-8
37+
config_file_path: MiniMax-M2.5-w8a8-QuaRot-A2.yaml
3538
multi_node:
3639
test_config:
3740
- name: multi-node-qwen3-235b-dp

tests/e2e/nightly/single_node/models/configs/MiniMax-M2.5-w8a8-QuaRot-A2.yaml

Lines changed: 10 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -6,16 +6,14 @@ test_cases:
66
- name: "MiniMax-M2.5-w8a8"
77
model: "Eco-Tech/MiniMax-M2.5-w8a8-QuaRot"
88
envs:
9-
HCCL_BUFFSIZE: "512"
9+
HCCL_BUFFSIZE: "1200"
1010
HCCL_OP_EXPANSION_MODE: "AIV"
1111
PYTORCH_NPU_ALLOC_CONF: "expandable_segments:True"
1212
VLLM_ASCEND_ENABLE_FLASHCOMM1: "1"
1313
OMP_NUM_THREADS: "1"
1414
TASK_QUEUE_ENABLE: "1"
15-
VLLM-ASCEND_BALANCE_SCHEDULING: "1"
16-
HCCL_INTRA_PCIE_ENABLE: "1"
17-
HCCL_INTRA_ROCE_ENABLE: "0"
18-
OMP_PROC_BIND: "false"
15+
VLLM_ASCEND_ENABLE_FUSED_MC2: "1"
16+
VLLM_ASCEND_ENABLE_NZ: "1"
1917
VLLM_TORCH_PROFILER_WITH_STACK: "0"
2018
VLLM_TORCH_PROFILER_DIR: "./profile"
2119
VLLM_USE_MODELSCOPE: "true"
@@ -30,23 +28,19 @@ test_cases:
3028
- "0.9"
3129
- "--quantization"
3230
- "ascend"
33-
- "--additional-config"
34-
- '{"enable_cpu_binding":true}'
35-
- "--model-loader-extra-config"
36-
- '{"enable_multithread_load":true,"num_threads":16}'
3731
- "--speculative_config"
3832
- '{"method":"eagle3","model":"vllm-ascend/MiniMax-M2.5-eagle-model-0318","num_speculative_tokens":3}'
3933
- "--enable-expert-parallel"
4034
- "--enable-chunked-prefill"
41-
- "--enable-prefix-caching"
35+
- "--no-enable-prefix-caching"
4236
- "--max-num-seqs"
43-
- "100"
37+
- "128"
4438
- "--max-model-len"
4539
- "196608"
4640
- "--seed"
4741
- "1024"
4842
- "--max-num-batched-tokens"
49-
- "6144"
43+
- "16384"
5044
- "--enable-auto-tool-choice"
5145
- "--tool-call-parser"
5246
- "minimax_m2"
@@ -56,7 +50,9 @@ test_cases:
5650
- "--profiler-config"
5751
- '{"profiler":"torch","torch_profiler_dir":"./profile","torch_profiler_with_stack":false}'
5852
- "--compilation-config"
59-
- '{"cudagraph_mode":"FULL_DECODE_ONLY","cudagraph_capture_sizes":[4,16,40,80,160,256,400]}'
53+
- '{"cudagraph_mode": "FULL_DECODE_ONLY"}'
54+
- "--additional-config"
55+
- '{"enable_cpu_binding": true, "enable_npugraph_ex": true, "enable_static_kernel": true}'
6056
benchmarks:
6157
acc:
6258
case_type: accuracy
@@ -84,5 +80,5 @@ test_cases:
8480
max_out_len: 1500
8581
batch_size: 120
8682
request_rate: 0
87-
baseline: 2042
83+
baseline: 1860.7
8884
threshold: 0.97

0 commit comments

Comments
 (0)