Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

ModelCloud
/
Meta-Llama-3.1-70B-Instruct-gptq-4bit

Text Generation
Transformers
Safetensors
llama
gptq
4bit
int4
gptqmodel
modelcloud
llama-3.1
70b
instruct
conversational
text-generation-inference
4-bit precision
Model card Files Files and versions
xet
Community
5
Meta-Llama-3.1-70B-Instruct-gptq-4bit
Ctrl+K
Ctrl+K
  • 3 contributors
History: 11 commits
Qubitium's picture
Qubitium
Update README.md
27937bd verified 11 months ago
  • .gitattributes
    1.52 kB
    initial commit 11 months ago
  • README.md
    14.3 kB
    Update README.md 11 months ago
  • config.json
    1.32 kB
    Upload folder using huggingface_hub (#3) 11 months ago
  • model-00001-of-00005.safetensors
    7.96 GB
    xet
    Upload folder using huggingface_hub (#3) 11 months ago
  • model-00002-of-00005.safetensors
    7.97 GB
    xet
    Upload folder using huggingface_hub (#3) 11 months ago
  • model-00003-of-00005.safetensors
    8 GB
    xet
    Upload folder using huggingface_hub (#3) 11 months ago
  • model-00004-of-00005.safetensors
    7.97 GB
    xet
    Upload folder using huggingface_hub (#3) 11 months ago
  • model-00005-of-00005.safetensors
    7.88 GB
    xet
    Upload folder using huggingface_hub (#3) 11 months ago
  • model.safetensors.index.json
    196 kB
    Upload folder using huggingface_hub (#1) 11 months ago
  • quantize_config.json
    347 Bytes
    Upload folder using huggingface_hub (#2) 11 months ago
  • special_tokens_map.json
    340 Bytes
    Upload folder using huggingface_hub (#1) 11 months ago
  • tokenizer.json
    9.09 MB
    Upload tokenizer.json (#5) 11 months ago
  • tokenizer_config.json
    50.9 kB
    Upload folder using huggingface_hub (#1) 11 months ago