Fix token_to_sequence returning Some(0) for out-of-bounds index - #2214

Fix token_to_sequence returning Some(0) for out-of-bounds index#2214

Osamaali313 wants to merge 1 commit into

huggingface:mainhuggingface/tokenizers:mainfrom

Osamaali313:fix/token-to-sequence-out-of-boundsOsamaali313/tokenizers:fix/token-to-sequence-out-of-boundsCopy head branch name to clipboard