Skip to content

fix: detach k, v in SelfAttention to prevent gradient accumulation - #221

Merged
hzhangxyz merged 1 commit into
mainfrom
fix/detach-kv
Mar 27, 2026
Merged

fix: detach k, v in SelfAttention to prevent gradient accumulation#221
hzhangxyz merged 1 commit into
mainfrom
fix/detach-kv

fix: detach k, v in SelfAttention to prevent gradient accumulation

ac1450f
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar