GGUF Quantizations
#11
by
Garydesu
- opened
Using quantized version with ollama running more smoothly is convenient.
There's already one on (bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF), which if we can provide a link it will be even better :D
Submit a PR for the README? Then should be good to go