benjamin
/

dolma2-tokenizer_superbpe_olmo2_p99_truncate_10G__extend_400K

Model card Files Files and versions

dolma2-tokenizer_superbpe_olmo2_p99_truncate_10G__extend_400K / vocab.json

Commit History

Upload tokenizer

fad07b2
verified

benjamin commited on Nov 22, 2025