CPU-Hybrid-MoE/DeepSeek-R1-0528-GPU-FP8-GPTQ4
Text Generation • 106B • Updated
• 4
CPU-Hybrid-MoE
community
AI & ML interests
Quantized MoE models for inference on CPU and hybrid CPU-GPU
CPU-Hybrid-MoE/DeepSeek-V3-0324-GPU-FP8-GPTQ4
Text Generation • 106B • Updated
• 5
CPU-Hybrid-MoE/DeepSeek-V3-0324-CPU-NUMA4-AMXINT8
Text Generation • Updated
• 1
CPU-Hybrid-MoE/DeepSeek-V3-0324-CPU-NUMA4-AMXINT4
Text Generation • Updated
• 1
CPU-Hybrid-MoE/DeepSeek-R1-0528-CPU-NUMA2-AMXINT4
Text Generation • Updated
CPU-Hybrid-MoE/DeepSeek-V3-0324-CPU-NUMA2-AMXINT4
Text Generation • Updated
CPU-Hybrid-MoE/GLM-4.5V-GPU-weight
Image-Text-to-Text • 33B • Updated
CPU-Hybrid-MoE/GLM-4.5-Air-GPU-weight
32B • Updated