Converter: per-tensor-type mixed precision (int8 for shared/o_proj/kv_b_proj, int4 rest)#243
Closed
woolcoxm wants to merge 1 commit into
Closed
Converter: per-tensor-type mixed precision (int8 for shared/o_proj/kv_b_proj, int4 rest)#243woolcoxm wants to merge 1 commit into
woolcoxm wants to merge 1 commit into
Enhance your code review process with GitHub Actions
GitHub Actions make it easy to automate all your software workflows, now with world-class CI/CD.
Build, test, and deploy your code right from GitHub. Learn more about GitHub Actions.
Linux, macOS, Windows, and containers
Matrix builds
Any language
Live logs
Built-in secret store
