benjamin
/

dolma2-tokenizer_superbpe_olmo2_p99_truncate_10G__extend_400K

Model card Files Files and versions

dolma2-tokenizer_superbpe_olmo2_p99_truncate_10G__extend_400K / tokenizer.json

benjamin's picture

Upload tokenizer

fad07b2 verified 24 days ago

history blame contribute delete

32.2 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )

SHA256:: 45e88b8a0b7b1372ccfd87bc92fcd38d5b9f87dfda553b51516b8cccc255f2b6
Pointer size:: 133 Bytes
Size of remote file:: 32.2 MB
Xet hash:: ff8a3427706b2e7806a5b791d268e2bcfc7a844e4260c22cc8351c566beab312

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.