perf(qwen35): recover dense AR replay fast path#476

Closed

dusterbloom wants to merge 6 commits into

Luce-Org:mainfrom

dusterbloom:perf/qwen35-ar-replay-microopts

Commits on Jul 1, 2026

perf(decode): fuse silu+mul -> swiglu_split in DeltaNet gated output
dusterbloom
committed
perf(qwen35): gate FWHT rotation for q4_0 KV + skip repeat_back in pure AR
dusterbloom
committed
perf(qwen35): cont concat inputs for fast concat_cont path
dusterbloom
committed
perf(qwen35): graph reuse in AR decode — skip rebuild within 256-token FA bucket
dusterbloom
committed
perf(qwen35): reduce concat cont overhead — materialize qkv_T once
dusterbloom
committed
perf(qwen35): keep AR replay micro-opts submodule-free
dusterbloom
committed