Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Misc with no match

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

71

Full-text search

Active filters: 3b

Triangle104/Llama3.2-3B-ShiningValiant2-Q6_K-GGUF

Text Generation • Updated Nov 19, 2024 • 4

Triangle104/Llama3.2-3B-ShiningValiant2-Q8_0-GGUF

Text Generation • Updated Nov 19, 2024 • 9

Khetterman/Llama-3.2-Kapusta-3B-v8

Text Generation • Updated Nov 20, 2024 • 19 • 1

mradermacher/Llama3.2-3B-Enigma-GGUF

Updated Nov 20, 2024 • 238

mradermacher/Llama3.2-3B-Enigma-i1-GGUF

Updated Nov 20, 2024 • 424

Khetterman/Llama-3.2-Kapusta-JapanChibi-3B-v1

Text Generation • Updated Nov 20, 2024

tensorblock/open-llama-3b-v2-elmv3-GGUF

Updated 2 days ago • 87

itlwas/Llama-3.2-Kapusta-3B-v8-Q4_K_M-GGUF

Updated Dec 18, 2024 • 6 • 1

itlwas/Llama-3.2-Kapusta-JapanChibi-3B-v1-Q4_K_M-GGUF

Updated Dec 18, 2024 • 16 • 1

itlwas/Llama-Deepsync-1B-Q4_K_M-GGUF

Text Generation • Updated Dec 29, 2024 • 10

mradermacher/Llama-Deepsync-1B-GGUF

Updated Dec 30, 2024 • 51

mradermacher/Llama-Deepsync-1B-i1-GGUF

Updated Dec 30, 2024 • 382

mradermacher/Llama-Deepsync-3B-GGUF

Updated Dec 31, 2024 • 53

mradermacher/Llama-Deepsync-3B-i1-GGUF

Updated Dec 31, 2024 • 87

QuantFactory/Llama-Deepsync-3B-GGUF

Text Generation • Updated Jan 3 • 197 • 2

bartowski/Llama-Deepsync-3B-GGUF

Text Generation • Updated Jan 4 • 312 • 1

QuantFactory/Llama-Deepsync-1B-GGUF

Text Generation • Updated Jan 4 • 74 • 3

matrixportal/Llama-3.2-Kapusta-3B-v8-GGUF

Updated Jan 14 • 24

roleplaiapp/SmallThinker-3B-Preview-Q2_K-GGUF

Text Generation • Updated Jan 16 • 5

roleplaiapp/SmallThinker-3B-Preview-Q3_K_S-GGUF

Text Generation • Updated Jan 16 • 5

roleplaiapp/SmallThinker-3B-Preview-Q3_K_M-GGUF

Text Generation • Updated Jan 16 • 4

roleplaiapp/SmallThinker-3B-Preview-Q3_K_L-GGUF

Text Generation • Updated Jan 16 • 14

roleplaiapp/SmallThinker-3B-Preview-Q4_0-GGUF

Text Generation • Updated Jan 16 • 6

roleplaiapp/SmallThinker-3B-Preview-Q4_K_S-GGUF

Text Generation • Updated Jan 16 • 7

roleplaiapp/SmallThinker-3B-Preview-Q4_K_M-GGUF

Text Generation • Updated Jan 16 • 4

roleplaiapp/SmallThinker-3B-Preview-Q5_0-GGUF

Text Generation • Updated Jan 16 • 3

roleplaiapp/SmallThinker-3B-Preview-Q5_K_S-GGUF

Text Generation • Updated Jan 16 • 4

roleplaiapp/SmallThinker-3B-Preview-Q5_K_M-GGUF

Text Generation • Updated Jan 16 • 4

roleplaiapp/SmallThinker-3B-Preview-Q6_K-GGUF

Text Generation • Updated Jan 16 • 4

roleplaiapp/SmallThinker-3B-Preview-Q8_0-GGUF

Text Generation • Updated Jan 16 • 6