Skip to content

TARGET MINIMAL RUST CRATE + .tok FORMAT - #2293

Open
ArthurZucker wants to merge 97 commits into
feat/train_encode_splitfrom
feat/tok-format
Open

TARGET MINIMAL RUST CRATE + .tok FORMAT#2293
ArthurZucker wants to merge 97 commits into
feat/train_encode_splitfrom
feat/tok-format

bench: add tok_bench, a single-thread throughput probe over a .tok

054bdf4
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar