Skip to content

Pre-transpose constant MatMul operand#315

Open
hsfzxjy wants to merge 4 commits intorobertknight:mainfrom
hsfzxjy:pretranspose-matmul
Open

Pre-transpose constant MatMul operand#315
hsfzxjy wants to merge 4 commits intorobertknight:mainfrom
hsfzxjy:pretranspose-matmul

Conversation

@hsfzxjy
Copy link
Copy Markdown
Contributor

@hsfzxjy hsfzxjy commented Aug 22, 2024

This PR adds support to pre-transpose MatMul RHS operands for faster inference, as discussed in https://www.reddit.com/r/rust/comments/1exjz7w/comment/lj7v5so/

@hsfzxjy hsfzxjy force-pushed the pretranspose-matmul branch from 9b616de to fa5469c Compare August 22, 2024 12:16
@robertknight
Copy link
Copy Markdown
Owner

Hello, just a belated note to say thanks for the PR. I haven't forgotten about this, I've just been focused on finishing some other work first.

@hsfzxjy
Copy link
Copy Markdown
Contributor Author

hsfzxjy commented Sep 15, 2024

It's OK.

@robertknight robertknight force-pushed the pretranspose-matmul branch from 0ab23a3 to 2fdcfe1 Compare July 2, 2025 19:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants