perf(bpe): wire the word cache into the batched model path, fused - #2308
Closed
ArthurZucker wants to merge 3 commits into
Closed
perf(bpe): wire the word cache into the batched model path, fused#2308ArthurZucker wants to merge 3 commits into
ArthurZucker wants to merge 3 commits into
