RedHatAI
/

Meta-Llama-3.1-70B-Instruct-quantized.w8a8

Text Generation

text-generation-inference

8-bit precision

compressed-tensors

Model card Files Files and versions Community

Meta-Llama-3.1-70B-Instruct-quantized.w8a8 / README.md

Commit History

Update README.md

fc8f281
verified

alexmarques commited on Jul 30, 2024

Update README.md

23e945d
verified

alexmarques commited on Jul 30, 2024

Create README.md

5048a55
verified

alexmarques commited on Jul 30, 2024