unsloth/Llama-3.2-1B-Instruct-GGUF

Text Generation • 1B • Updated May 9, 2025 • 65.1k • 54

Note pp512: 4168.69 ± 937.92 | tg128: 143.90 ± 7.15 [UD-Q6_K_XL]

unsloth/OLMo-2-0425-1B-Instruct-GGUF

Text Generation • 1B • Updated May 1, 2025 • 349 • 7

Note pp512: 4563.71 ± 55.46 | tg128: 135.19 ± 0.38 [UD-Q6_K_XL]

unsloth/LFM2-8B-A1B-GGUF

Text Generation • 8B • Updated Oct 8, 2025 • 1.87k • 43

Note pp512: 2352.90 ± 40.45 | tg128: 111.49 ± 2.38 [UD-Q6_K_XL]

ggml-org/SmolVLM2-2.2B-Instruct-GGUF

2B • Updated Apr 30, 2025 • 5.59k • 27

Note pp512: 2062.47 ± 316.51 | tg128: 97.45 ± 4.51 [Q8_0]

ggml-org/gpt-oss-20b-GGUF

21B • Updated Oct 30, 2025 • 50.9k • 125

Note pp512: 752.08 ± 13.02 | tg128: 66.05 ± 3.15 [MXFP4]

bartowski/Nanbeige_Nanbeige4-3B-Thinking-2511-GGUF

Text Generation • 4B • Updated Dec 10, 2025 • 3k • 15

Note pp512: 1442.34 ± 110.00 | tg128: 84.12 ± 8.04 [IQ4_NL]

bartowski/XiaomiMiMo_MiMo-VL-7B-RL-2508-GGUF

Image-Text-to-Text • 8B • Updated Sep 2, 2025 • 295 • 1

Note pp512: 704.39 ± 25.41 | tg128: 42.12 ± 5.50 [IQ4_NL]

ggml-org/Kimi-VL-A3B-Thinking-2506-GGUF

16B • Updated Aug 20, 2025 • 1.8k • 27

Note pp512: 852.78 ± 40.09 | tg128: 45.57 ± 0.81 [Q8_0]

unsloth/Nemotron-3-Nano-30B-A3B-GGUF

Text Generation • 32B • Updated Dec 31, 2025 • 91.6k • 246

Note pp512: 493.86 ± 2.23 | tg128: 40.13 ± 0.47 [UD-Q6_K_XL]

unsloth/Seed-Coder-8B-Reasoning-GGUF

Text Generation • 8B • Updated May 18, 2025 • 1.46k • 11

Note pp512: 834.67 ± 4.36 | tg128: 28.63 ± 0.30 [UD-Q6_K_XL]

unsloth/rnj-1-instruct-GGUF

8B • Updated Jan 1 • 2.52k • 8

Note pp512: 677.64 ± 10.98 | tg128: 26.79 ± 0.71 [UD-Q6_K_XL]

Intel/MiniMax-M2-REAP-172B-A10B-gguf-q2ks-mixed-AutoRound

173B • Updated Dec 12, 2025 • 201 • 6

Note pp512: 182.88 ± 3.84 | tg128: 26.21 ± 0.44 [Q2_K_S]

bartowski/ServiceNow-AI_Apriel-1.6-15b-Thinker-GGUF

Image-Text-to-Text • 14B • Updated Dec 12, 2025 • 7.89k • 25

Note pp512: 338.01 ± 5.23 | tg128: 25.25 ± 0.39 [IQ4_NL]

unsloth/GLM-4.6V-Flash-GGUF

Image-Text-to-Text • 9B • Updated Dec 27, 2025 • 28.8k • 81

Note pp512: 639.56 ± 2.57 | tg128: 23.76 ± 0.04 [UD-Q6_K_XL]

unsloth/Apertus-8B-Instruct-2509-GGUF

Text Generation • 8B • Updated Oct 5, 2025 • 2.8k • 16

Note pp512: 546.45 ± 33.03 | tg128: 19.44 ± 0.24 [UD-Q6_K_XL]

unsloth/Phi-4-reasoning-plus-GGUF

Text Generation • 15B • Updated May 1, 2025 • 3.86k • 77

Note pp512: 417.69 ± 13.85 | tg128: 15.35 ± 0.32 [UD-Q6_K_XL]

unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF

Image-to-Text • 108B • Updated Jun 17, 2025 • 105k • 134

Note pp512: 138.94 ± 2.66 | tg128: 15.34 ± 1.97 [UD-IQ3_XXS]

bartowski/mistralai_Devstral-Small-2-24B-Instruct-2512-GGUF

Text Generation • 24B • Updated Dec 9, 2025 • 17k • 48

Note pp512: 179.34 ± 0.99 | tg128: 14.57 ± 0.12 [IQ4_NL]

unsloth/Devstral-Small-2-24B-Instruct-2512-GGUF

24B • Updated Dec 15, 2025 • 157k • 94

Note pp512: 245.79 ± 5.41 | tg128: 9.80 ± 0.03 [UD-Q6_K_XL]

unsloth/Olmo-3.1-32B-Think-GGUF

32B • Updated Dec 17, 2025 • 757 • 7

Note pp512: 179.13 ± 5.12 | tg128: 7.04 ± 0.17 [UD-Q6_K_XL]

unsloth/Seed-OSS-36B-Instruct-GGUF

Text Generation • 36B • Updated Aug 24, 2025 • 2.27k • 41

Note pp512: 166.54 ± 4.16 | tg128: 6.33 ± 0.02 [UD-Q6_K_XL]

unsloth/Kimi-Dev-72B-GGUF

73B • Updated Jun 17, 2025 • 5.14k • 48

Note pp512: 68.09 ± 0.25 | tg128: 5.11 ± 0.32 [UD-IQ3_XXS]