Hugging Face's logo

ggml-org
/
SmolVLM-Instruct-GGUF

GGUF
conversational
Model card Files Community

SmolVLM-Instruct

Original model: https://huggingface.co/HuggingFaceTB/SmolVLM-Instruct

For more info, please refer to this PR: https://github.com/ggml-org/llama.cpp/pull/13050

Downloads last month
81
GGUF
Model size
1.81B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

4-bit

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ggml-org/SmolVLM-Instruct-GGUF

Base model

HuggingFaceTB/SmolLM2-1.7B
Quantized
HuggingFaceTB/SmolLM2-1.7B-Instruct
Quantized
HuggingFaceTB/SmolVLM-Instruct
Quantized
(7)
this model

Collection including ggml-org/SmolVLM-Instruct-GGUF