Llama gguf?
#1
by
phazei
- opened
Can the llama 3.1 8b be replace with another llama 3.1 8b gguf or fine tune?
This model was trained using Llama 3.1 8B. While GGUF versions or other fine-tuned variants may be compatible, they have not been tested.
Since it don't fit on most consumer gpu, that would definitly be a plus value!
Thanks for releasing the model, it looks very promising 😀
please add a way to use gguf with this.