27 4 14

cicdatopea

cicdatopea

AI & ML interests

None yet

Recent Activity

new activity about 20 hours ago

huggingface/documentation-images:auto-round

updated a model 1 day ago

OPEA/gemma-3-27b-it-int4-AutoRound

updated a model 1 day ago

OPEA/gemma-3-12b-it-int4-AutoRound

View all activity

Organizations

cicdatopea's activity

New activity in huggingface/documentation-images about 20 hours ago

auto-round

#481 opened about 22 hours ago by

cicdatopea

New activity in OPEA/gemma-3-27b-it-int4-AutoRound 1 day ago

so consider build a model for GPU?

#1 opened about 1 month ago by

New activity in OPEA/Llama-3.1-Nemotron-70B-Instruct-HF-int4-sym-inc 2 days ago

Update config.json

#1 opened 2 days ago by

weiweiz1

New activity in OPEA/QwQ-32B-int4-AutoRound-awq-asym 5 days ago

它是否正常工作,或是我的情况是否正常

#1 opened 7 days ago by

qianchenccc

New activity in OPEA/Mistral-Small-3.1-24B-Instruct-2503-int4-AutoRound-awq-sym 11 days ago

Chat Template needs fixed

#1 opened 14 days ago by

allenc87

New activity in OPEA/Qwen2-VL-72B-Instruct-int2-sym-inc 19 days ago

Qwen2.5-VL-72B-Instruct quant?

#1 opened 22 days ago by

samgreen

New activity in OPEA/DeepSeek-R1-int4-gptq-sym-inc 19 days ago

VLLM 0.7.2 can start the model normally, but there is no output when simulating a request using Curl, it blocks!

#2 opened 2 months ago by

JZMALi

New activity in OPEA/DeepSeek-R1-int2-gptq-sym-inc 26 days ago

Could we get a int3 version of gptq please?

#1 opened 27 days ago by

davidsyoung

New activity in kaitchup/QwQ-32B-AutoRoundGPTQ-4bit 30 days ago

Qwen-32B overflow issue

#1 opened about 1 month ago by

cicdatopea

New activity in kaitchup/Qwen2.5-72B-Instruct-AutoRound-GPTQ-4bit 30 days ago

how to run this model

#1 opened 30 days ago by

cicdatopea

New activity in deepseek-ai/DeepSeek-V3-0324 about 1 month ago

Can a quantized version of deepseek-v3-0324 be implemented on a machine with a cluster of 8 *A100s?

#19 opened about 1 month ago by

xueshuai

New activity in OPEA/DeepSeek-V3-int4-sym-awq-inc about 1 month ago

without licence

#2 opened about 1 month ago by

Futureli

New activity in OPEA/DeepSeek-R1-fp8-static-w8a8-inc about 1 month ago

how to inference this model?

#1 opened about 1 month ago by

xiximayou

New activity in kaitchup/Llama-3.3-70B-Instruct-AutoRound-GPTQ-4bit about 2 months ago

Your quants are not listed in the base model

#2 opened about 2 months ago by

dazipe

New activity in OPEA/DeepSeek-R1-int4-gptq-sym-inc 2 months ago

sglang inference issue

#1 opened 2 months ago by

su400

New activity in OPEA/DeepSeek-V3-int4-sym-awq-inc 3 months ago

Start on cpu with vllm.

#1 opened 3 months ago by

kuliev-vitaly

New activity in Intel/Qwen2-7B-int4-inc 3 months ago

“a larger accuracy drop in Chinese tasks"? how much exectaly?

#1 opened 3 months ago by

chuangzhidian

New activity in OPEA/DeepSeek-V3-int4-sym-gptq-inc 3 months ago

A bug when running the demo inference on GPU

#5 opened 3 months ago by

HuggingLianWang

New activity in OPEA/DeepSeek-V3-int4-sym-gptq-inc 4 months ago

vllm

#4 opened 4 months ago by

NikolaSigmoid

Base model please!

#2 opened 4 months ago by

deltanym