RedHatAI
/

Sparse-Llama-3.1-8B-tldr-2of4-FP8-dynamic

Text Generation

text-generation-inference

compressed-tensors

Model card Files Files and versions

Sparse-Llama-3.1-8B-tldr-2of4-FP8-dynamic

Commit History

Update README.md

75a2b48
verified

alexmarques commited on 2 days ago

Update README.md

1f1977d
verified

alexmarques commited on 2 days ago

Update README.md

7a4ffde
verified

alexmarques commited on 2 days ago

Update README.md

d993353
verified

alexmarques commited on 2 days ago

Update README.md

dcecdab
verified

alexmarques commited on 2 days ago

Rename chart (3).png to inference_performance/latency.png

9c18b32
verified

alexmarques commited on 2 days ago

Upload chart (3).png

06d2188
verified

alexmarques commited on 2 days ago

Create README.md

da16282
verified

alexmarques commited on 2 days ago

Upload folder using huggingface_hub

ded1434
verified

alexmarques commited on 4 days ago

initial commit

0196796
verified

alexmarques commited on 4 days ago