Skip to content

llama : add option to override model tensor buffers#11397

Merged
slaren merged 9 commits into
masterfrom
sl/custom-tensor-offload
Apr 2, 2025
Merged

llama : add option to override model tensor buffers#11397
slaren merged 9 commits into
masterfrom
sl/custom-tensor-offload

disable pipeline parallelism when there are tensor overrides

2e4e8b1
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs