RedHatAI
/

Sparse-Llama-3.1-8B-tldr-2of4-FP8-dynamic

Text Generation

text-generation-inference

compressed-tensors

Model card Files Files and versions

Sparse-Llama-3.1-8B-tldr-2of4-FP8-dynamic / inference_performance

Ctrl+K

Ctrl+K

1 contributor

History: 1 commit

alexmarques's picture

Rename chart (3).png to inference_performance/latency.png

9c18b32 verified 9 days ago

latency.png

32.6 kB

Rename chart (3).png to inference_performance/latency.png 9 days ago