Skip to content

aorko01/Flash_GPT_2

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

About

Custom GPT-2 with memory-efficient FlashAttention implemented in Triton for faster training in PyTorch.

Stars

Watchers

Forks

Releases

Packages

Contributors

Languages