Non-record: Value Residual (-0.015 BPB) + Gated Attention (-0.003 BPB) with ablations#413
Open
anantdgoel wants to merge 1 commit intoopenai:mainfrom
Open
Non-record: Value Residual (-0.015 BPB) + Gated Attention (-0.003 BPB) with ablations#413anantdgoel wants to merge 1 commit intoopenai:mainfrom
anantdgoel wants to merge 1 commit intoopenai:mainfrom
Commits
Commits on Mar 22, 2026
- authored andcommitted
