Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

6,142

Full-text search

Active filters: gptq

openbmb/MiniCPM4-8B-Eagle-FRSpec-QAT-cpmcu

Text Generation • Updated 1 day ago • 38 • 7

openbmb/MiniCPM4-8B-marlin-cpmcu

Text Generation • Updated 1 day ago • 31 • 5

openbmb/MiniCPM4-8B-marlin-Eagle-vLLM

Text Generation • Updated 1 day ago • 65 • 4

openbmb/MiniCPM4-8B-marlin-vLLM

Text Generation • Updated 1 day ago • 113 • 4

mratsim/GLM-4-32B-0414.w4a16-gptq

Text2Text Generation • Updated 14 days ago • 952 • 3

mratsim/Devstral-Small-2505.w4a16-gptq

Text2Text Generation • Updated 13 days ago • 1.73k • 2

TheBloke/Llama-2-13B-chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 3.6k • 365

TheBloke/CodeLlama-7B-Python-GPTQ

Text Generation • Updated Sep 27, 2023 • 64 • 24

TheBloke/WizardCoder-Python-13B-V1.0-GPTQ

Text Generation • Updated Sep 27, 2023 • 379 • 76

TheBloke/Mixtral-8x7B-Instruct-v0.1-GPTQ

Text Generation • Updated Dec 14, 2023 • 9.25k • 137

Qwen/Qwen1.5-4B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 32 • 6

venera-ai/SeaLLM-7B-v2.5-4bit

Text Generation • Updated Apr 27, 2024 • 22 • 2

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9, 2024 • 2.13k • 25

AIDC-AI/Ovis2-4B-GPTQ-Int4

Image-Text-to-Text • Updated Mar 25 • 681 • 3

wolfofbackstreet/DeepCoder-14B-Preview-int4-qptq-v1

Text Generation • Updated Apr 23 • 96 • 1

kaitchup/GLM-Z1-32B-0414-autoround-gptq-4bit

Updated Apr 28 • 403 • 3

kaitchup/Qwen3-14B-autoround-4bit-gptq

Updated May 2 • 511 • 1

Qwen/Qwen3-30B-A3B-GPTQ-Int4

Text Generation • Updated 18 days ago • 67.6k • 14

Qwen/Qwen3-235B-A22B-GPTQ-Int4

Text Generation • Updated 18 days ago • 7.6k • 14

QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Lite

Text Generation • Updated 4 days ago • 54 • 1

QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Compact

Text Generation • Updated 4 days ago • 351 • 1

ziyingchen1106/Llama-3.2-3B-Instruct-fp16-lora-gptqmodel-4bit

Text Generation • Updated 6 days ago • 28 • 1

c1uc/Llama-3.2-3B-Instruct-lora-4bit-g128

Updated 4 days ago • 389 • 1

QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Medium

Text Generation • Updated 3 days ago • 85 • 1

TheBloke/Xwin-MLewd-7B-V0.2-GPTQ

Text Generation • Updated Oct 31, 2023 • 42 • 22

elinas/alpaca-13b-lora-int4

Text Generation • Updated Apr 5, 2023 • 7 • 41

elinas/alpaca-30b-lora-int4

Text Generation • Updated Apr 5, 2023 • 12 • 68

mayaeary/pygmalion-6b-4bit-128g

Text Generation • Updated Mar 28, 2023 • 44 • 40

mayaeary/pygmalion-6b_dev-4bit-128g

Text Generation • Updated Mar 28, 2023 • 25 • 120

mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g

Text Generation • Updated Mar 31, 2023 • 16 • 2