numen-tech's picture
Add weights
583c5ab
metadata
language:
  - en
license: apache-2.0
base_model: ruslanmv/Medical-Llama3-v2
base_model_relation: quantized
library_name: mlc-llm
pipeline_tag: text-generation

3-bit OmniQuant quantized version of Medical-Llama3-v2 for inference with the Private LLM app.