Skip to content

Commit 9dcbeaa

Browse files
authored
[TEST] Modify the configuration of the 310p test case (vllm-project#12007)
### What this PR does / why we need it? Modify the configuration of the 310p test case ### Does this PR introduce _any_ user-facing change? no ### How was this patch tested? - vLLM version: v0.24.0 - vLLM main: vllm-project/vllm@85c09e9 --------- Signed-off-by: zxinyue <1264904584@qq.com> Signed-off-by: taozi01319 <68981779+taozi01319@users.noreply.github.com>
1 parent 1955e74 commit 9dcbeaa

2 files changed

Lines changed: 14 additions & 2 deletions

File tree

tests/e2e/weekly/single_node/configs/Qwen3-14B-w8a8sc-310p.yaml

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -48,11 +48,12 @@ test_cases:
4848
case_type: accuracy
4949
dataset_path: vllm-ascend/SuperGLUE
5050
request_conf: vllm_api_general_chat
51-
dataset_conf: BoolQ/SuperGLUE_BoolQ_gen_0_shot_cot_str
51+
dataset_conf: SuperGLUE/SuperGLUE_BoolQ_gen_0_shot_cot_str
5252
max_out_len: 10240
5353
batch_size: 32
5454
baseline: 89.3
5555
threshold: 1
5656
temperature: 0
5757
top_p: 0.95
5858
ignore_eos: false
59+

tests/e2e/weekly/single_node/configs/Qwen3-32B-w8a8sc-310p.yaml

Lines changed: 12 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -26,7 +26,7 @@ test_cases:
2626
- "--load_format"
2727
- "sharded_state"
2828
- "--compilation-config"
29-
- '{"cudagraph_mode":"FULL_DECODE_ONLY", "cudagraph_capture_sizes":[8,32]}'
29+
- '{"cudagraph_mode":"FULL_DECODE_ONLY", "cudagraph_capture_sizes":[32]}'
3030
- "--additional-config"
3131
- '{"ascend_compilation_config":{"enable_npugraph_ex":false, "fuse_norm_quant": false}}'
3232
- "--default-chat-template-kwargs"
@@ -44,3 +44,14 @@ test_cases:
4444
request_rate: 0
4545
baseline: 105.26
4646
threshold: 0.95
47+
acc:
48+
case_type: accuracy
49+
dataset_path: vllm-ascend/gsm8k
50+
request_conf: vllm_api_general_chat
51+
dataset_conf: gsm8k/gsm8k_gen_0_shot_cot_chat_prompt
52+
max_out_len: 10240
53+
batch_size: 32
54+
baseline: 95.07
55+
threshold: 1
56+
temperature: 0
57+
top_p: 0.95

0 commit comments

Comments
 (0)