modify optimization_debug_options tests - #1002
Conversation
…ptions tests - test_npu_cuda_graph_bs.py: debug-full-2-npu-a3 -> full-2-npu-a3 - test_npu_embedding_interpolation.py: debug-full-1-npu-a3 -> full-1-npu-a3 - test_npu_no_extra_forked_npu_context.py: debug-full-2-npu-a3 -> full-2-npu-a3 Co-Authored-By: Claude <noreply@anthropic.com>
CLA Signature Guide@Sugar920 , thanks for your pull request. The following commit(s) are not associated with a signed Contributor License Agreement (CLA).
To sign CLA, click here. To check if your email is configured correctly, refer to the FAQs. Once you've signed the CLA or updating your email, please comment |
Co-Authored-By: Claude <noreply@anthropic.com>
CLA Signature Guide@Sugar920 , thanks for your pull request. The following commit(s) are not associated with a signed Contributor License Agreement (CLA).
To sign CLA, click here. To check if your email is configured correctly, refer to the FAQs. Once you've signed the CLA or updating your email, please comment |
…raph bs tests Remove debug print block in test_npu_cuda_graph_bs.py and stderr assertions in test_npu_msprobe_dump_config.py — both are redundant; the downstream assertions (assertEqual on decode_bs and dump.json file check) already cover the end-to-end validation. Co-Authored-By: Claude <noreply@anthropic.com>
CLA Signature Guide@Sugar920 , thanks for your pull request. The following commit(s) are not associated with a signed Contributor License Agreement (CLA).
To sign CLA, click here. To check if your email is configured correctly, refer to the FAQs. Once you've signed the CLA or updating your email, please comment |
Cherry-pick test_npu_disaggregation_pp.py and test_npu_pp_single_node.py from debug branch (PR Ascend#801). Co-Authored-By: Claude <noreply@anthropic.com>
CLA Signature Guide@Sugar920 , thanks for your pull request. The following commit(s) are not associated with a signed Contributor License Agreement (CLA).
To sign CLA, click here. To check if your email is configured correctly, refer to the FAQs. Once you've signed the CLA or updating your email, please comment |
Cherry-pick test_npu_full_decode_graph_gsm8k.py from testcase-npu-model-tokenizer branch (PR Ascend#886). Co-Authored-By: Claude <noreply@anthropic.com>
CLA Signature Guide@Sugar920 , thanks for your pull request. The following commit(s) are not associated with a signed Contributor License Agreement (CLA).
To sign CLA, click here. To check if your email is configured correctly, refer to the FAQs. Once you've signed the CLA or updating your email, please comment |
Co-Authored-By: Claude <noreply@anthropic.com>
CLA Signature Guide@Sugar920 , thanks for your pull request. The following commit(s) are not associated with a signed Contributor License Agreement (CLA).
To sign CLA, click here. To check if your email is configured correctly, refer to the FAQs. Once you've signed the CLA or updating your email, please comment |
Co-Authored-By: Claude <noreply@anthropic.com>
CLA Signature Guide@Sugar920 , thanks for your pull request. The following commit(s) are not associated with a signed Contributor License Agreement (CLA).
To sign CLA, click here. To check if your email is configured correctly, refer to the FAQs. Once you've signed the CLA or updating your email, please comment |
… from debug - test_npu_cuda_graph_bs.py: fix _BS_LOG_RE regex to match NPU prefill CG capture log format num_tokens=[...], migrate to new CG flags - test_npu_model_tokenizer.py: accumulated changes from debug branch Co-Authored-By: Claude <noreply@anthropic.com>
CLA Signature Guide@Sugar920 , thanks for your pull request. The following commit(s) are not associated with a signed Contributor License Agreement (CLA).
To sign CLA, click here. To check if your email is configured correctly, refer to the FAQs. Once you've signed the CLA or updating your email, please comment |
CLA Signature Guide@Sugar920 , thanks for your pull request. The following commit(s) are not associated with a signed Contributor License Agreement (CLA).
To sign CLA, click here. To check if your email is configured correctly, refer to the FAQs. Once you've signed the CLA or updating your email, please comment |
CLA Signature Guide@Sugar920 , thanks for your pull request. The following commit(s) are not associated with a signed Contributor License Agreement (CLA).
To sign CLA, click here. To check if your email is configured correctly, refer to the FAQs. Once you've signed the CLA or updating your email, please comment |
CLA Signature Guide@Sugar920 , thanks for your pull request. The following commit(s) are not associated with a signed Contributor License Agreement (CLA).
To sign CLA, click here. To check if your email is configured correctly, refer to the FAQs. Once you've signed the CLA or updating your email, please comment |
Co-Authored-By: Claude <noreply@anthropic.com>
CLA Signature Guide@Sugar920 , thanks for your pull request. The following commit(s) are not associated with a signed Contributor License Agreement (CLA).
To sign CLA, click here. To check if your email is configured correctly, refer to the FAQs. Once you've signed the CLA or updating your email, please comment |
| f" Mean TTFT: {t1:.1f} ms (max_bs=1) vs {t8:.1f} ms (max_bs=8)\n" | ||
| f" P99 TTFT: {p1:.1f} ms (max_bs=1) vs {p8:.1f} ms (max_bs=8)" | ||
| ) | ||
| self.assertGreater(t1, 0) |
| continue | ||
| parts = [p.strip() for p in line.split("|")] | ||
| for part in parts: | ||
| if part.isdigit() and 3 <= len(part) <= 7: |
| """Testcase: Verify TP server does not create extra NPU processes beyond TP workers. | ||
|
|
||
| [Test Category] Parameter | ||
| [Test Target] --cuda-graph-backend-decode; --cuda-graph-backend-prefill |
| metrics = run_eval(args) | ||
| print(f"{metrics=}") | ||
|
|
||
| self.assertGreater(metrics["score"], 0.24) |
| register_npu_ci(est_time=10800, suite="full-16-npu-a3", nightly=True) | ||
|
|
||
|
|
||
| class TestPPAccuracy(unittest.TestCase): |
| @classmethod | ||
| def setUpClass(cls): | ||
| cls.model = LLAMA_3_1_8B_INSTRUCT_WEIGHTS_PATH | ||
| cls.base_url = "http://127.0.0.1:23333" |
| time.sleep(4) | ||
|
|
||
|
|
||
| class TestFixedBugs(unittest.TestCase): |
| time.sleep(4) | ||
|
|
||
|
|
||
| class TestFixedBugs(unittest.TestCase): |
CI States
Latest PR Test (Base): ❌ Missing
run-cilabel -- add it to run CI tests.Latest PR Test (Extra): ❌ Blocked --
run-ciis required first.