Skip to content

Swiglu gating_ QAT_Residual Attention Scalin _EMA- Sliding window_Optimizations for 10min/16MB Track#2159

Open
visin109 wants to merge 3 commits into
openai:mainfrom
visin109:main
Open

Swiglu gating_ QAT_Residual Attention Scalin _EMA- Sliding window_Optimizations for 10min/16MB Track#2159
visin109 wants to merge 3 commits into
openai:mainfrom
visin109:main

Commits

Commits on Apr 30, 2026