Hugging Face's logo

DevQuasar
/
nvidia.Llama-3.1-Nemotron-70B-Instruct-HF-GGUF

Text Generation
GGUF
conversational
Model card Files Community

'Make knowledge free for everyone'

Quantized version of: nvidia/Llama-3.1-Nemotron-70B-Instruct-HF Buy Me a Coffee at ko-fi.com

Downloads last month
66
GGUF
Model size
70.6B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for DevQuasar/nvidia.Llama-3.1-Nemotron-70B-Instruct-HF-GGUF

Base model

meta-llama/Llama-3.1-70B
Finetuned
meta-llama/Llama-3.1-70B-Instruct
Finetuned
nvidia/Llama-3.1-Nemotron-70B-Instruct-HF
Quantized
(45)
this model
Adapters
1 model

Collection including DevQuasar/nvidia.Llama-3.1-Nemotron-70B-Instruct-HF-GGUF