wikilangs/shn

Text Generation • Updated Jan 10 • 1

aymaralima/deeplima

Updated May 5, 2024 • 3

gsar78/Greek_Tokenizer

Updated Aug 5, 2024 • 1

microsoft/VidTok

Updated Apr 5, 2025 • 42

Emova-ollm/emova_speech_tokenizer_hf

Feature Extraction • 0.1B • Updated Oct 8, 2025 • 333 • 2

metinovadilet/kyrgyz_t5_tokenizer

Updated Feb 24, 2025

microsoft/vidtwin

Updated Mar 20, 2025 • 2

JephteyAdolphe/ht_core_news_sm

Updated May 1, 2025

Hanbaike/kyrgyz_bpe_16000

Updated May 8, 2025

Hanbaike/kyrgyz_bpe_24000

Updated May 8, 2025

Hanbaike/kyrgyz_bpe_32000

Updated May 8, 2025

Hanbaike/kyrgyz_bpe_4000

Updated May 8, 2025

Hanbaike/kyrgyz_bpe_51200

Updated May 8, 2025

Hanbaike/kyrgyz_bpe_8000

Updated May 8, 2025

Hanbaike/kyrgyz_unigram_16000

Updated May 8, 2025

Hanbaike/kyrgyz_unigram_24000

Updated May 8, 2025

Hanbaike/kyrgyz_unigram_32000

Updated May 8, 2025

Hanbaike/kyrgyz_unigram_4000

Updated May 8, 2025

Hanbaike/kyrgyz_unigram_51200

Updated May 8, 2025

Hanbaike/kyrgyz_unigram_8000

Updated May 8, 2025

Hanbaike/kyrgyz_spm_tokenizer

Updated May 8, 2025

Hengzongshu/Chinse_BBPE_Vocab

Text Classification • Updated Jun 1, 2025

khopilot/khmer-tokenizer-v7

Feature Extraction • Updated Oct 7, 2025 • 1 • 1

toksuite/google-gemma-2-2b

Text Generation • 2B • Updated Dec 25, 2025 • 151

toksuite/common-pile-comma-v0.1

Text Generation • 2B • Updated Dec 25, 2025 • 220

toksuite/meta-llama-Llama-3.2-1B

Text Generation • 2B • Updated Dec 25, 2025 • 154

toksuite/microsoft-Phi-3-mini-4k-instruct

Text Generation • 1B • Updated Dec 25, 2025 • 126

toksuite/gpt2

Text Generation • 1B • Updated Dec 25, 2025 • 145

toksuite/bigscience-bloom

Text Generation • 2B • Updated Dec 25, 2025 • 281

toksuite/facebook-xglm-564M

Text Generation • 2B • Updated Dec 25, 2025 • 143