gemma-2-27b-gguf

gemma-2-27b-gguf is a GGUF Q4_K_M int4 quantized version of Google's Gemma-2-27B with Instruct Training (IT), providing an inference implementation, optimized for AI PCs.

gemma-2-27b-gguf is a leading open source foundation model from Google.

Model Description

  • Developed by: Google
  • Model type: gemma-2-27b
  • Parameters: 27 billion
  • Model Parent: google/gemma-2-27b-it
  • Language(s) (NLP): English
  • License: Apache 2.0
  • Uses: General purpose chat
  • RAG Benchmark Accuracy Score: NA
  • Quantization: int4

Model Card Contact

llmware on github

llmware on hf

llmware website

Downloads last month
2
GGUF
Model size
27.2B params
Architecture
gemma2
Hardware compatibility
Log In to view the estimation

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for llmware/gemma-2-27b-instruct-gguf

Base model

google/gemma-2-27b
Quantized
(61)
this model