Skip to content

modify optimization_debug_options tests - #1002

Open
Sugar920 wants to merge 12 commits into
Ascend:testcasesfrom
Sugar920:testcase-optimization-debug-options-v2
Open

modify optimization_debug_options tests#1002
Sugar920 wants to merge 12 commits into
Ascend:testcasesfrom
Sugar920:testcase-optimization-debug-options-v2

Conversation

@Sugar920

@Sugar920 Sugar920 commented Jul 14, 2026

Copy link
Copy Markdown

CI States

Latest PR Test (Base): ❌ Missing run-ci label -- add it to run CI tests.
Latest PR Test (Extra): ❌ Blocked -- run-ci is required first.

…ptions tests

- test_npu_cuda_graph_bs.py: debug-full-2-npu-a3 -> full-2-npu-a3
- test_npu_embedding_interpolation.py: debug-full-1-npu-a3 -> full-1-npu-a3
- test_npu_no_extra_forked_npu_context.py: debug-full-2-npu-a3 -> full-2-npu-a3

Co-Authored-By: Claude <noreply@anthropic.com>
@ascend-robot

Copy link
Copy Markdown

CLA Signature Guide

@Sugar920 , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit Reason
a5a8c7f7 fix: change CI suite from debug-... the email used in the commit is not linked to a signed CLA!
please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

@github-actions github-actions Bot added the npu label Jul 14, 2026
@Sugar920 Sugar920 changed the title fix: change CI suite from debug-full to full for optimization_debug_options tests modify optimization_debug_options tests Jul 14, 2026
Co-Authored-By: Claude <noreply@anthropic.com>
@ascend-robot

Copy link
Copy Markdown

CLA Signature Guide

@Sugar920 , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit Reason
a5a8c7f7 fix: change CI suite from debug-... the email used in the commit is not linked to a signed CLA!
please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

…raph bs tests

Remove debug print block in test_npu_cuda_graph_bs.py and stderr
assertions in test_npu_msprobe_dump_config.py — both are redundant;
the downstream assertions (assertEqual on decode_bs and dump.json
file check) already cover the end-to-end validation.

Co-Authored-By: Claude <noreply@anthropic.com>
@ascend-robot

Copy link
Copy Markdown

CLA Signature Guide

@Sugar920 , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit Reason
a5a8c7f7 fix: change CI suite from debug-... the email used in the commit is not linked to a signed CLA!
please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

Cherry-pick test_npu_disaggregation_pp.py and test_npu_pp_single_node.py
from debug branch (PR Ascend#801).

Co-Authored-By: Claude <noreply@anthropic.com>
@ascend-robot

Copy link
Copy Markdown

CLA Signature Guide

@Sugar920 , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit Reason
a5a8c7f7 fix: change CI suite from debug-... the email used in the commit is not linked to a signed CLA!
please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

Cherry-pick test_npu_full_decode_graph_gsm8k.py from
testcase-npu-model-tokenizer branch (PR Ascend#886).

Co-Authored-By: Claude <noreply@anthropic.com>
@ascend-robot

Copy link
Copy Markdown

CLA Signature Guide

@Sugar920 , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit Reason
a5a8c7f7 fix: change CI suite from debug-... the email used in the commit is not linked to a signed CLA!
please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

Co-Authored-By: Claude <noreply@anthropic.com>
@ascend-robot

Copy link
Copy Markdown

CLA Signature Guide

@Sugar920 , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit Reason
a5a8c7f7 fix: change CI suite from debug-... the email used in the commit is not linked to a signed CLA!
please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

Co-Authored-By: Claude <noreply@anthropic.com>
@ascend-robot

Copy link
Copy Markdown

CLA Signature Guide

@Sugar920 , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit Reason
a5a8c7f7 fix: change CI suite from debug-... the email used in the commit is not linked to a signed CLA!
please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

… from debug

- test_npu_cuda_graph_bs.py: fix _BS_LOG_RE regex to match NPU prefill
  CG capture log format num_tokens=[...], migrate to new CG flags
- test_npu_model_tokenizer.py: accumulated changes from debug branch

Co-Authored-By: Claude <noreply@anthropic.com>
@ascend-robot

Copy link
Copy Markdown

CLA Signature Guide

@Sugar920 , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit Reason
a5a8c7f7 fix: change CI suite from debug-... the email used in the commit is not linked to a signed CLA!
please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

@ascend-robot

Copy link
Copy Markdown

CLA Signature Guide

@Sugar920 , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit Reason
a5a8c7f7 fix: change CI suite from debug-... the email used in the commit is not linked to a signed CLA!
please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

@ascend-robot

Copy link
Copy Markdown

CLA Signature Guide

@Sugar920 , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit Reason
a5a8c7f7 fix: change CI suite from debug-... the email used in the commit is not linked to a signed CLA!
please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

@ascend-robot

Copy link
Copy Markdown

CLA Signature Guide

@Sugar920 , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit Reason
a5a8c7f7 fix: change CI suite from debug-... the email used in the commit is not linked to a signed CLA!
please verify that it matches the email you used when signing the CLA.
d115dc90 Refactor CUDA graph batch size l... the email used in the commit is not linked to a signed CLA!
please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

Co-Authored-By: Claude <noreply@anthropic.com>
@ascend-robot

Copy link
Copy Markdown

CLA Signature Guide

@Sugar920 , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit Reason
a5a8c7f7 fix: change CI suite from debug-... the email used in the commit is not linked to a signed CLA!
please verify that it matches the email you used when signing the CLA.
d115dc90 Refactor CUDA graph batch size l... the email used in the commit is not linked to a signed CLA!
please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

f" Mean TTFT: {t1:.1f} ms (max_bs=1) vs {t8:.1f} ms (max_bs=8)\n"
f" P99 TTFT: {p1:.1f} ms (max_bs=1) vs {p8:.1f} ms (max_bs=8)"
)
self.assertGreater(t1, 0)

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this assertion reasonable?

continue
parts = [p.strip() for p in line.split("|")]
for part in parts:
if part.isdigit() and 3 <= len(part) <= 7:

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is it possible to misjudge?

"""Testcase: Verify TP server does not create extra NPU processes beyond TP workers.

[Test Category] Parameter
[Test Target] --cuda-graph-backend-decode; --cuda-graph-backend-prefill

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Only test disable?

metrics = run_eval(args)
print(f"{metrics=}")

self.assertGreater(metrics["score"], 0.24)

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is 0.24 normal?

register_npu_ci(est_time=10800, suite="full-16-npu-a3", nightly=True)


class TestPPAccuracy(unittest.TestCase):

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Use CustomTestCase?

@classmethod
def setUpClass(cls):
cls.model = LLAMA_3_1_8B_INSTRUCT_WEIGHTS_PATH
cls.base_url = "http://127.0.0.1:23333"

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Use DEFAULT_URL_FOR_TEST instead?

time.sleep(4)


class TestFixedBugs(unittest.TestCase):

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Use CustomTestCase instead?

time.sleep(4)


class TestFixedBugs(unittest.TestCase):

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The class name isn't appropriate

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants