Skip to content

feat(atomsplit): run deepseek's pre-tokenizer with no regex backend - #2265

Draft
SBrandeis wants to merge 6 commits into
feat/train_encode_splitfrom
deepseek-fsm
Draft

feat(atomsplit): run deepseek's pre-tokenizer with no regex backend#2265
SBrandeis wants to merge 6 commits into
feat/train_encode_splitfrom
deepseek-fsm

bench: measure the pipeline in the configuration it ships

780b71d
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar