Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

turboderp
/
dbrx-instruct-exl2

Model card Files Files and versions Community
2
dbrx-instruct-exl2 / README.md
turboderp's picture
turboderp
Update README.md
cedaba5 verified about 1 year ago
preview code
|
raw
history blame contribute delete
812 Bytes

EXL2 quants of dbrx-instruct.

Tokenizer from here

2.20 bits per weight
2.30 bits per weight
2.75 bits per weight
3.00 bits per weight
3.40 bits per weight
3.75 bits per weight

measurement.json