v2ray's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in Qwen/Qwen-Image 7 months ago

It's so unsafe that it can generate inappropriate adult content easily

🤯 1

51

#21 opened 7 months ago by

liougehooa

New activity in QuixiAI/DeepSeek-R1-0528-AWQ 9 months ago

running with flashmla on A100s

1

#1 opened 9 months ago by

ehartford

New activity in QuixiAI/DeepSeek-V3-0324-AWQ 9 months ago

could you give me a reason why you ignore kv_a_proj_with_mqa layer when quantizing this model?

1

#10 opened 9 months ago by

superahn

New activity in dphn/Dolphin3.0-Llama3.1-8B-GGUF 9 months ago

gshshdhdhhdididhxbcbdhdudhbdbdbdbehe

4

#3 opened 9 months ago by

MYNK337

New activity in QuixiAI/DeepSeek-R1-AWQ 9 months ago

H800 has errors

1

#35 opened 9 months ago by

yiyepialing

New activity in QuixiAI/DeepSeek-R1-AWQ 10 months ago

update vllm to 0.8.x and meet some trouble

3

#34 opened 10 months ago by

HuggingLianWang

New activity in QuixiAI/DeepSeek-V3-0324-AWQ 10 months ago

Stuck when run on 8xH100

1

#8 opened 10 months ago by

Thai

New activity in QuixiAI/DeepSeek-V3-0324-AWQ 11 months ago

why tokenizer_config.json changed for AWQ model.

2

#7 opened 11 months ago by

rockcat-miao

Does FlashMLA support kv cache fp8 dtype and how to enable FlashMLA ?

10

#6 opened 11 months ago by

CharlesLincoln

New activity in QuixiAI/DeepSeek-R1-AWQ 11 months ago

AMD Instinct MI210 + vllm fail to run this model, any solutions please? Is there any other deepseek-r1-671b models that can run succesfully on AMD Instinct MI210 + vllm? Thanks!

5

#33 opened 11 months ago by

luciagan

New activity in discord-community/WelcomeBot 11 months ago

test

👀 3

156

#2 opened 12 months ago by

adamm-hf

New activity in QuixiAI/DeepSeek-R1-AWQ 11 months ago

How to Resolve "GLIBC_2.32 Not Found" Error When Deploying vLLM Environment?

8

#32 opened 11 months ago by

lastsummerLi

New activity in QuixiAI/DeepSeek-V3-0324-AWQ 11 months ago

Can the 4090 device run this model?

3

#3 opened 11 months ago by

jinzhongwei

vllm crach with a slightly longer prompt

1

#4 opened 11 months ago by

rockcat-miao

可以添加一下LICENSE文件吗？

2

#2 opened 11 months ago by

adol-ch

New activity in QuixiAI/DeepSeek-R1-AWQ 11 months ago

Are there any updates to the recommended commands?

5

#27 opened 11 months ago by

NaiveYan

Why hasn't the MTP layer of the 61st layer been quantized?

1

#30 opened 11 months ago by

yang001002

Is there any testing on the support for running on other memory capacities

1

#29 opened 11 months ago by

HRan2004

Any one can run this model with SGlang framework？

5

#13 opened about 1 year ago by

muziyongshixin

DeepSeek-R1-AWQ quantized model missing one layer of experts

4

#28 opened 11 months ago by

virilo