Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

34,901

Full-text search

Active filters: 4-bit

TheBloke/Rosa_v2_7B-GPTQ

Text Generation • Updated Jan 5, 2024 • 16 • 2

Anarchist/llama-instruct-wizard-orca

Text Generation • Updated Jan 5, 2024 • 18

TheBloke/Open_Gpt4_8x7B-AWQ

Text Generation • Updated Jan 5, 2024 • 17 • 2

TheBloke/Open_Gpt4_8x7B-GPTQ

Text Generation • Updated Jan 6, 2024 • 10 • 9

nicesen/sen-llama

Text Generation • Updated Jan 6, 2024 • 13

Anarchist/llama-bad-roleplay

Text Generation • Updated Jan 6, 2024 • 25 • 2

AlignmentLab-AI/teensyorca

Text Generation • Updated Jan 13, 2024 • 26

TheBloke/zephyr-quiklang-3b-GPTQ

Text Generation • Updated Jan 6, 2024 • 19 • 1

TheBloke/LLaMA-Pro-8B-AWQ

Text Generation • Updated Jan 6, 2024 • 15 • 3

TheBloke/LLaMA-Pro-8B-GPTQ

Text Generation • Updated Jan 6, 2024 • 110 • 2

isaiahbjork/tinyllama-function-calling-v0.1-merge

Text Generation • Updated Jan 18, 2024 • 11

Danielbrdz/Barcenas-Mixtral-8x7b-4bit

Text Generation • Updated Jan 6, 2024 • 17

TheBloke/Pallas-0.5-frankenmerge-GPTQ

Text Generation • Updated Jan 6, 2024 • 16 • 1

TheBloke/Pallas-0.5-frankenmerge-AWQ

Text Generation • Updated Jan 6, 2024 • 21 • 1

TheBloke/bagel-8x7b-v0.2-GPTQ

Text Generation • Updated Jan 6, 2024 • 24 • 3

TheBloke/bagel-8x7b-v0.2-AWQ

Text Generation • Updated Jan 6, 2024 • 22 • 1

TheBloke/zephyr-quiklang-3b-4K-GPTQ

Text Generation • Updated Jan 6, 2024 • 24 • 2

TheBloke/Sensualize-Solar-10.7B-GPTQ

Text Generation • Updated Jan 6, 2024 • 24 • 8

TheBloke/Sensualize-Solar-10.7B-AWQ

Text Generation • Updated Jan 6, 2024 • 25 • 2

TheBloke/sonya-medium-x8-MoE-GPTQ

Text Generation • Updated Jan 7, 2024 • 18 • 3

danielhanchen/test2

Text Generation • Updated Jan 7, 2024 • 19

danielhanchen/test3

Text Generation • Updated Jan 7, 2024 • 17

Delosint/firsttestmodel

Updated Jan 7, 2024 • 1

TheBloke/LLaMA-Pro-8B-Instruct-GPTQ

Text Generation • Updated Jan 7, 2024 • 474 • 5

TheBloke/LLaMA-Pro-8B-Instruct-AWQ

Text Generation • Updated Jan 7, 2024 • 439 • 1

TheBloke/Noromaid-13B-v0.3-AWQ

Text Generation • Updated Jan 7, 2024 • 21 • 2

TheBloke/Noromaid-13B-v0.3-GPTQ

Text Generation • Updated Jan 7, 2024 • 17 • 9

Muhammadreza/Nucleus-1B-GPTQ

Text Generation • Updated Jan 7, 2024 • 12 • 1

KnutJaegersberg/MoMo-72B-4bit

Text Generation • Updated Jan 13, 2024 • 16

danielhanchen/test4

Text Generation • Updated Jan 7, 2024 • 12