Hugging Face's logo
HandH1998's picture
13 1

HandH1998

HandH1998
·

AI & ML interests

None yet

Recent Activity

updated a model about 2 months ago
HandH1998/DeepSeek-R1-QQQ-channel
published a model about 2 months ago
HandH1998/DeepSeek-R1-QQQ-channel
updated a model about 2 months ago
HandH1998/DeepSeek-R1-QQQ-g128
View all activity

Organizations

meituan's profile picture SGLang Project's profile picture

HandH1998's activity

updated a model about 2 months ago
published a model about 2 months ago
updated a model about 2 months ago
published a model about 2 months ago
liked a model about 2 months ago
New activity in meituan/DeepSeek-R1-Block-INT8 2 months ago

After deploying with the latest sglang, I found that the responses when calling the interface were chaotic.

4
#13 opened 2 months ago by
ShiningMaker

是否有明确的sglang镜像版本推荐：）

1
#14 opened 2 months ago by
wangkkk956
New activity in meituan/DeepSeek-R1-Channel-INT8 2 months ago

Add `quantization_config` in config.json?

4
#4 opened 2 months ago by
WeiwenXia

运行channel INT8后sglang报错OOM

1
#3 opened 2 months ago by
zhangneilc
New activity in meituan/DeepSeek-R1-Block-INT8 2 months ago

量化类型

1
#11 opened 2 months ago by
a-r-c
New activity in meituan/DeepSeek-R1-Channel-INT8 3 months ago

Difference with Block-wise Int8?

1
#1 opened 3 months ago by
leo98xh
updated a model 3 months ago
New activity in meituan/DeepSeek-R1-Block-INT8 3 months ago

Why hasn't the model file size changed?

1
#9 opened 3 months ago by
yu5
updated a model 3 months ago
New activity in cognitivecomputations/DeepSeek-V3-AWQ 3 months ago

What calibration dataset do you use when applying AWQ?

2
#5 opened 3 months ago by
HandH1998
updated 2 models 10 months ago