halley-ai/Qwen3-Next-80B-A3B-Instruct-MLX-5bit-gs32
Text Generation
â˘
80B
â˘
Updated
â˘
20
â˘
1
Halley AI
company
Verified
AI & ML interests
Text Generation & Chat Assistants; Model Compression & Quantization (Q4/Q6/Q8, gs32); Inference & Serving (on-prem, low-latency); RAG / Retrieval; Agents & Tool Use; Distillation / LoRA / Fine-tuning
halley-ai/Qwen3-Next-80B-A3B-Instruct-MLX-6bit-gs64
Text Generation
â˘
80B
â˘
Updated
â˘
17
â˘
1
halley-ai/Qwen3-Next-80B-A3B-Instruct-MLX-4bit-gs64
Text Generation
â˘
80B
â˘
Updated
â˘
20
â˘
1
halley-ai/gpt-oss-120b-MLX-bf16
Text Generation
â˘
117B
â˘
Updated
â˘
192
â˘
2
halley-ai/gpt-oss-120b-MLX-8bit-gs32
Text Generation
â˘
117B
â˘
Updated
â˘
75
â˘
1
halley-ai/gpt-oss-120b-MLX-6bit-gs64
Text Generation
â˘
117B
â˘
Updated
â˘
58
â˘
1
halley-ai/gpt-oss-20b-MLX-5bit-gs32
Text Generation
â˘
21B
â˘
Updated
â˘
33
â˘
1
halley-ai/gpt-oss-20b-MLX-6bit-gs32
Text Generation
â˘
21B
â˘
Updated
â˘
36
â˘
1
halley-ai/gpt-oss-20b-MLX-4bit-gs32
Text Generation
â˘
21B
â˘
Updated
â˘
59
â˘
1