Skip to content

Run submodel inference in parallel using CUDA streams#18

Merged
kmaziarz merged 3 commits into
mainfrom
kmaziarz/parallelize-ensemble-model-inference
Jun 10, 2026
Merged

Run submodel inference in parallel using CUDA streams#18
kmaziarz merged 3 commits into
mainfrom
kmaziarz/parallelize-ensemble-model-inference

feat(inference): Add flag to turn parallelization off

6542eb1
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar