Fernanda24's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in cerebras/DeepSeek-V3.2-REAP-508B-A37B about 2 months ago

FP8 versions of DeepSeek-V3.2 would awesome!

2

#1 opened 2 months ago by

Fernanda24

liked a model about 2 months ago

ubergarm/GLM-4.7-GGUF

Text Generation • 358B • Updated Dec 24, 2025 • 477 • 24

New activity in cerebras/DeepSeek-V3.2-REAP-345B-A37B 2 months ago

ValueError: gemm_fp8_nt_groupwise is only supported on SM100, SM103 in trtllm backend.

#3 opened 2 months ago by

Fernanda24

liked a model 2 months ago

cerebras/DeepSeek-V3.2-REAP-508B-A37B

Text Generation • 508B • Updated Dec 9, 2025 • 18 • 14

New activity in eousphoros/DeepSeek-V3.2-NVFP4 2 months ago

Is it possible to make smaller NVFP4 quant at 340-360GB to fit in 4x96gb?

👍 1

68

#1 opened 3 months ago by

Fernanda24

liked a model 2 months ago

ubergarm/Devstral-2-123B-Instruct-2512-GGUF

Text Generation • Updated Dec 10, 2025 • 328 • 6

New activity in Kebob/DeepSeek-V3.2-CPU-NUMA2-AMXINT4 3 months ago

attention backend

1

#1 opened 3 months ago by

Fernanda24

New activity in QuantTrio/DeepSeek-V3.2-AWQ 3 months ago

Aww Man!

20

#1 opened 3 months ago by

mtcl

New activity in Intel/DeepSeek-V3.1-Terminus-int4-mixed-AutoRound 3 months ago

Question will it work in vllm or sglang with rtx 6000 blackwells? cuda arch sm120

6

#1 opened 4 months ago by

Fernanda24

New activity in QuantTrio/DeepSeek-V3.1-AWQ-Lite 3 months ago

ooof this fits in 4x96gb can we get this for the new 3.2 Speciale ase well please :)

16

#2 opened 3 months ago by

Fernanda24

New activity in tencent/DeepSeek-V3.1-Terminus-W4AFP8 3 months ago

4 x RTX PRO 6000

👍 1

2

#1 opened 3 months ago by

willfalco

New activity in eousphoros/DeepSeek-V3.2-NVFP4 3 months ago

How did you bypass deepseek-v32 not recognized in Tranformers?

3

#3 opened 3 months ago by

Fernanda24

liked a model 3 months ago

QuantTrio/DeepSeek-V3.2-Speciale-AWQ

Text Generation • 685B • Updated Dec 29, 2025 • 29 • 4

New activity in deepseek-ai/DeepSeek-V3.2 3 months ago

model type `deepseek_v32` not found

5

#16 opened 3 months ago by

harryhan618

reacted to csabakecskemeti's post with 👀 3 months ago

view post

Post

2094

Looking for some help to test an INT8 Deepseek 3.2:
SGLang supports Channel wise INT8 quants on CPUs with AMX instructions (Xeon 5 and above AFAIK)
https://lmsys.org/blog/2025-07-14-intel-xeon-optimization/

Currently uploading an INT8 version of Deepseek 3.2 Speciale:
DevQuasar/deepseek-ai.DeepSeek-V3.2-Speciale-Channel-INT8

I cannot test this I'm on AMD
"AssertionError: W8A8Int8LinearMethod on CPU requires that CPU has AMX support"
(I assumed it can fall back to some non optimized kernel but seems not)

If anyone with the required resources (Intel Xeon 5/6 + ~768-1TB ram) can help to test this that would be awesome.

If you have hints how to make this work on AMD Threadripper 7000 Pro series please guide me.

Thanks all!

See translation

• 
• 
• 
• 8 replies

·

👀

2

2

+

Reply

New activity in QuantTrio/DeepSeek-V3.2-AWQ 3 months ago

Aww Man!

20

#1 opened 3 months ago by

mtcl

New activity in mistralai/Ministral-3-14B-Instruct-2512 3 months ago

Update README.md

1

#4 opened 3 months ago by

Fernanda24

broken link to mistral small

1

#3 opened 3 months ago by

Fernanda24

liked 2 models 3 months ago

mistralai/Ministral-3-14B-Instruct-2512

Updated Jan 15 • 337k • 253

QuantTrio/DeepSeek-V3.2-AWQ

Text Generation • 685B • Updated Dec 3, 2025 • 97.5k • 11