RedHatAI
/

Sparse-Llama-3.1-8B-tldr-2of4-FP8-dynamic

Text Generation

text-generation-inference

compressed-tensors

Model card Files Files and versions

alexmarques commited on 3 days ago

Commit

9c18b32

·

verified ·

1 Parent(s): 06d2188

Rename chart (3).png to inference_performance/latency.png

Files changed (1) hide show

chart (3).png → inference_performance/latency.png +0 -0

chart (3).png → inference_performance/latency.png RENAMED Viewed

File without changes