Edit Models filters

Model Tree

ISTA-DASLab/Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

3

Full-text search

Active filters: ISTA-DASLab/Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16

PrunaAI/ISTA-DASLab-Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16-HQQ-1bit-smashed

Text Generation • Updated Jul 20, 2024 • 19

PrunaAI/ISTA-DASLab-Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16-HQQ-4bit-smashed

Text Generation • Updated Jul 20, 2024 • 14

PrunaAI/ISTA-DASLab-Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16-HQQ-2bit-smashed

Text Generation • Updated Jul 20, 2024 • 16