Skip to content

Code change to use flash attn 2#202

Open
yhyu13 wants to merge 2 commits intoOpenBMB:masterfrom
yhyu13:master
Open

Code change to use flash attn 2#202
yhyu13 wants to merge 2 commits intoOpenBMB:masterfrom
yhyu13:master

Conversation

@yhyu13
Copy link
Contributor

@yhyu13 yhyu13 commented Nov 22, 2023

Use transformer implementation of flash attention2

related issue #201

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant