Skip to content

add qwen3 scope3 tile helper example#94

Draft
high-cloud wants to merge 1 commit intohw-native-sys:mainfrom
high-cloud:codex/qwen3-scope3-tile-helper
Draft

add qwen3 scope3 tile helper example#94
high-cloud wants to merge 1 commit intohw-native-sys:mainfrom
high-cloud:codex/qwen3-scope3-tile-helper

Conversation

@high-cloud
Copy link
Copy Markdown
Contributor

@high-cloud high-cloud commented Apr 10, 2026

What changed

  • Added examples/models/qwen3/qwen3_32b_decode_scope3_tile.py as a tile/helper-oriented Scope 3 example for Qwen3 decode.
  • Kept the optimized fused gate/up and fused down-projection InCore helpers in the new file so the tile-level structure is easy to inspect independently.
  • Added stage comments aligned to the current InCore execution order.

Why

The existing qwen3_32b_decode_scope3.py file is useful for baseline scope validation, but the optimized helper version is easier to review when inspecting tile-level structure and fused InCore boundaries.

Impact

  • Adds a standalone example for reviewing and iterating on the current Scope 3 tile/helper implementation.
  • Does not change existing examples or runtime behavior outside the new file.

Performance

The helper structure in qwen3_32b_decode_scope3_tile.py comes from the same Scope 3 fusion work that was profiled on examples/models/qwen3/qwen3_32b_decode_scope3.py with runtime profiling enabled.

Measured with:

  • python examples/models/qwen3/qwen3_32b_decode_scope3.py -p a2a3 -d 7 --runtime-profiling

Representative results:

  • Baseline Scope 3 implementation: 3295.18 us
  • Fused gate/up helper: 3038.68 us (-7.8% vs baseline)
  • Fused gate/up + fused down-projection helper: 2822.68 us (-14.3% vs baseline, -7.1% vs gate-only fused)

Validation

  • python examples/models/qwen3/qwen3_32b_decode_scope3_tile.py -p a2a3 -d 7
  • python examples/models/qwen3/qwen3_32b_decode_scope3.py -p a2a3 -d 7 --runtime-profiling

@gemini-code-assist
Copy link
Copy Markdown

Warning

You have reached your daily quota limit. Please wait up to 24 hours and I will start processing your requests again!

@coderabbitai
Copy link
Copy Markdown

coderabbitai bot commented Apr 10, 2026

Important

Review skipped

Draft detected.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: 56872bf7-3e35-49a8-8e57-5dc9244494e6

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@high-cloud high-cloud changed the title [codex] add qwen3 scope3 tile helper example add qwen3 scope3 tile helper example Apr 10, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant