Skip to content

cuda : enable CUDA graphs for MMID 1 <= BS <= 4#19645

Merged
ggerganov merged 3 commits into
masterfrom
gg/cuda-graphs-enable-bs-gt1
Feb 17, 2026
Merged

cuda : enable CUDA graphs for MMID 1 <= BS <= 4#19645
ggerganov merged 3 commits into
masterfrom
gg/cuda-graphs-enable-bs-gt1

cont : add MMVQ_MMID_MAX_BATCH_SIZE

573b94c
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar