Skip to content

cuda: COLI_GROUP_ASYNC=1 — overlap the CPU expert rows with the GPU groups at decode (opt-in, +6-8%)#342

Open
ZacharyZcR wants to merge 3 commits into
JustVugg:devfrom
ZacharyZcR:feat/expert-group-overlap
Open

cuda: COLI_GROUP_ASYNC=1 — overlap the CPU expert rows with the GPU groups at decode (opt-in, +6-8%)#342
ZacharyZcR wants to merge 3 commits into
JustVugg:devfrom
ZacharyZcR:feat/expert-group-overlap

fix Windows async expert loader

5978d05
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

2 warnings
macos
succeeded Jul 18, 2026 in 1m 13s