Skip to content

fix: detach k, v in SelfAttention to prevent gradient accumulation - #221

Merged
hzhangxyz merged 1 commit into
mainfrom
fix/detach-kv
Mar 27, 2026
Merged

fix: detach k, v in SelfAttention to prevent gradient accumulation#221
hzhangxyz merged 1 commit into
mainfrom
fix/detach-kv

Commits

Commits on Mar 27, 2026