Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
tclf90
/
qwen2.5-72b-instruct-gptq-int3
like
0
Text Generation
Safetensors
13 languages
qwen2
qwen2.5
gptq
int3
vLLM
sglang
conversational
3-bit
License:
qwen
Model card
Files
Files and versions
Community
1
Use this model
This is a mirror repo from modelscope tclf90/qwen2.5-72b-instruct-gptq-int3
This is a mirror repo from modelscope
tclf90/qwen2.5-72b-instruct-gptq-int3
Downloads last month
3
Safetensors
Model size
9.71B params
Tensor type
I32
·
FP16
·
Chat template
Files info
Inference Providers
NEW
Text Generation
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for
tclf90/qwen2.5-72b-instruct-gptq-int3
Base model
Qwen/Qwen2.5-72B
Finetuned
Qwen/Qwen2.5-72B-Instruct
Quantized
(
84
)
this model