Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

8-bit precision

text-generation-inference

4-bit precision

Carbon Emissions

text-embeddings-inference

Misc with no match

Mixture of Experts

Models

147

Full-text search

Active filters: nncf

AIFunOver/Falcon3-10B-Instruct-openvino-8bit

Text Generation • Updated Dec 27, 2024 • 15

AIFunOver/Falcon3-10B-Instruct-openvino-4bit

Text Generation • Updated Dec 27, 2024 • 33

AIFunOver/phi-4-openvino-fp16

Text Generation • Updated Jan 9 • 21 • 1

AIFunOver/phi-4-openvino-8bit

Text Generation • Updated Jan 9 • 19

AIFunOver/phi-4-openvino-4bit

Text Generation • Updated Jan 9 • 43 • 2

AIFunOver/Sky-T1-32B-Preview-openvino-8bit

Text Generation • Updated Jan 14 • 9

AIFunOver/Sky-T1-32B-Preview-openvino-4bit

Text Generation • Updated Jan 14 • 15

AIFunOver/Qwen2.5-7B-Instruct-1M-openvino-fp16

Text Generation • Updated Jan 28 • 18

AIFunOver/Qwen2.5-7B-Instruct-1M-openvino-8bit

Text Generation • Updated Jan 28 • 34

AIFunOver/Qwen2.5-7B-Instruct-1M-openvino-4bit

Text Generation • Updated Jan 28 • 30

AIFunOver/Qwen2.5-14B-Instruct-1M-openvino-8bit

Text Generation • Updated Jan 28 • 12

AIFunOver/Qwen2.5-14B-Instruct-1M-openvino-4bit

Text Generation • Updated Jan 28 • 17

AIFunOver/DeepSeek-R1-Distill-Qwen-32B-openvino-8bit

Text Generation • Updated Jan 28 • 13

AIFunOver/DeepSeek-R1-Distill-Qwen-32B-openvino-4bit

Text Generation • Updated Jan 28 • 61

AIFunOver/DeepSeek-R1-Distill-Llama-8B-openvino-8bit

Text Generation • Updated Jan 29 • 59

AIFunOver/DeepSeek-R1-Distill-Llama-8B-openvino-4bit

Text Generation • Updated Jan 29 • 32

hsuwill000/Qwen2.5-0.5B-Instruct-openvino-4bit

Text Generation • Updated Feb 5 • 11

boysbytes/DeepSeek-R1-Distill-Qwen-1.5B-openvino-8bit

Text Generation • Updated Feb 9 • 35

boysbytes/DeepSeek-R1-Distill-Qwen-1.5B-openvino-4bit

Text Generation • Updated Feb 9 • 74

bal723/TinyLlama-1.1B-Chat-v1.0-openvino-4bit

Updated Mar 5 • 14

hsuwill000/Qwen2.5-1.5B-Instruct-abliterated-openvino-8bit

Text Generation • Updated Mar 7 • 16

windchant/DeepSeek-R1-Distill-Qwen-1.5B-openvino-8bit

Text Generation • Updated Mar 11 • 35

windchant/DeepSeek-R1-Distill-Qwen-1.5B-openvino-4bit

Text Generation • Updated Mar 11 • 10

windchant/Qwen2.5-0.5B-Instruct-openvino-4bit

Text Generation • Updated Mar 11 • 90

Keenah285/Phi-3-mini-4k-instruct-openvino-4bit

Text Generation • Updated Apr 18 • 12

DomosFS/french-bge-m3-openvino-8bit

Sentence Similarity • Updated 13 days ago • 215

yzu1114621/resnet-50-openvino-8bit

Image Classification • Updated 7 days ago • 22