Skip to content

MLA kv cache: fix split graph backend assignment when kv cache store on CPU#13648

Closed
xiang1guo wants to merge 1 commit into
ggml-org:masterfrom
xiang1guo:xiang/master/fix-mla-kv-cache-offload
Closed

MLA kv cache: fix split graph backend assignment when kv cache store on CPU#13648
xiang1guo wants to merge 1 commit into
ggml-org:masterfrom
xiang1guo:xiang/master/fix-mla-kv-cache-offload

src: llama-graph: MLA kv cache: fix split graph backend assignment wh…

0fb5ca6
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs