eoe/Qwen2-0.5B-Instruct-Q4_0-GGUF
Text Generation
•
0.5B
•
Updated
•
5
eoe
eoe
AI & ML interests
None yet
Recent Activity
commented on
a paper
11 days ago
Shallow-π: Knowledge Distillation for Flow-based VLAs
liked
a Space
12 days ago
2025-ai-timeline/2025-ai-timeline
reacted
to
MonsterMMORPG's
post
with ❤️
25 days ago
Compared Quality and Speed Difference (with CUDA 13 & Sage Attention) of BF16 vs GGUF Q8 vs FP8 Scaled vs NVFP4 for Z Image Turbo, FLUX Dev, FLUX SRPO, FLUX Kontext, FLUX 2 - Full 4K step by step tutorial also published
Full 4K tutorial : https://youtu.be/XDzspWgnzxI
Check above full 4K tutorial to learn more and see uncompressed original quality and size images
It was always wondered how much quality and speed difference exists between BF16, GGUF, FP8 Scaled and NVFP4 precisions. In this tutorial I have compared all these precision and quantization variants for both speed and quality. The results are pretty surprising. Moreover, we have developed and published NVFP4 model quant generator app and FP8 Scaled quant generator apps. The links of the apps are below if you want to use them. Furthermore, upgrading ComfyUI to CUDA 13 with properly compiled libraries is now very much recommended. We have observed some noticeable performance gains with CUDA 13. So for both SwarmUI and ComfyUI solo users, CUDA 13 ComfyUI is now recommended.
Organizations
None yet