Edit Models filters

Models

99

Full-text search

Active filters: bpe

espnet/xeus

Automatic Speech Recognition • Updated Jun 17, 2025 • 25 • 144

gsar78/Greek_Tokenizer

Updated Aug 5, 2024 • 1

ydl1y17/asset-keywords-tokenizer

Updated Sep 18, 2024

charanhu/kannada-tokenizer

Text Generation • Updated Nov 12, 2024 • 2

aloobun/IN-Llama-3-Tokenizer

Updated Mar 7, 2025

Saiteja/telugu-bpe

Updated Jan 5, 2025 • 4

aayushraina/hindi-bpe-tokenizer

Text Generation • Updated Jan 11, 2025

aayushraina/bpe-hindi

Text Generation • Updated Jan 11, 2025

prithivMLmods/Bpe-vocab-n-OCR

Image-to-Text • Updated May 3, 2025 • 6 • 4

mradermacher/Tokenized-OCR-GGUF

2B • Updated Jul 31, 2025 • 46 • 1

mradermacher/Tokenized-OCR-i1-GGUF

2B • Updated Jul 11, 2025 • 145

muzaffercky/kurdish-kurmanji-tokenizer

Updated Jun 30, 2025 • 4

mradermacher/Bpe-vocab-n-OCR-GGUF

2B • Updated Jul 31, 2025 • 594

mradermacher/Bpe-vocab-n-OCR-i1-GGUF

2B • Updated Jul 11, 2025 • 206 • 1

Hailay/geez-tokenizer

Token Classification • Updated Jul 15, 2025

Hengzongshu/Chinse_BBPE_Vocab

Text Classification • Updated Jun 1, 2025

Vipplav/telugu-bpe-23k

Updated Jun 19, 2025

Max1798/my-tokenizer

Updated Jul 17, 2025 • 2

amirhofo/Persian-BPE-Tokenizer

Updated Jul 24, 2025

yakul259/english-bpe-tokenizer-60k

Updated Aug 14, 2025

yakul259/finance-bpe-tokenizer-30k

Updated Aug 15, 2025

toksuite/common-pile-comma-v0.1

Text Generation • 2B • Updated Dec 25, 2025 • 13

toksuite/meta-llama-Llama-3.2-1B

Text Generation • 2B • Updated Dec 25, 2025 • 45

toksuite/microsoft-Phi-3-mini-4k-instruct

Text Generation • 1B • Updated Dec 25, 2025 • 31

toksuite/gpt2

Text Generation • 1B • Updated Dec 25, 2025 • 59

toksuite/bigscience-bloom

Text Generation • 2B • Updated Dec 25, 2025 • 58

MustafaSeker/sugartrq-tokenizer-tr

Updated Sep 2, 2025

toksuite/mistralai-tekken

Text Generation • 2B • Updated Dec 25, 2025 • 25

toksuite/Qwen-Qwen3-8B

Text Generation • 2B • Updated Dec 25, 2025 • 33

nursimakgul/turkish-tokenizer

Updated Sep 6, 2025