HF-Quantization/Llama-3.3-70B-Instruct-TORCHAO-W8
Updated
HF Quantization
community
AI & ML interests
Making AI models smaller, and faster with Quantization
HF-Quantization/Llama-3.3-70B-Instruct-TORCHAO-W4
Updated
HF-Quantization/Llama-3.2-1B-BNB-INT8
1B
•
Updated
•
4
HF-Quantization/Llama-3.2-1B-BNB-NF4
1B
•
Updated
•
4
HF-Quantization/Llama-3.2-1B-BNB-FP4
1B
•
Updated
•
31
HF-Quantization/Llama-3.2-1B-BNB-NF4-BF16
1B
•
Updated
•
4
HF-Quantization/Llama-3.2-1B-BNB-FP4-BF16
1B
•
Updated
•
4
HF-Quantization/Llama-3.2-1B-TORCHAO-W8A8
Updated
•
4
HF-Quantization/Llama-3.2-1B-TORCHAO-W8
Updated
HF-Quantization/Llama-3.2-1B-TORCHAO-W4
Updated
•
5
HF-Quantization/Llama-3.2-1B-GPTQ-INT4
1B
•
Updated