perf(pipeline): don't stride an input that has no cut points - #2283

Merged

ArthurZucker merged 3 commits into

feat/multi_threaded_pipelinefrom

perf/parallel-uncuttable-input

Aug 6, 2026

Commits on Aug 4, 2026

fix(pipeline): don't stride an input that has no cut points
ArthurZucker
committed
f9342ae
bench(ab_giga_mt): multi-thread arm of the gigatoken A/B
ArthurZucker
committed
04ff7e4

Commits on Aug 5, 2026

Delete tokenizers/tk-encode/examples/ab_giga_mt.rs
ArthurZucker
authored
4b5ad13