Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,8 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
These GGUF quants were made from https://huggingface.co/fancyfeast/llama-joycaption-beta-one-hf-llava and designed for use in KoboldCpp 1.91 and above.
|
| 2 |
+
|
| 3 |
+
Contains 3 GGUF quants of Joycaption Beta One, as well as the associated mmproj file.
|
| 4 |
+
|
| 5 |
+
To use:
|
| 6 |
+
- Download the main model (Llama-Joycaption-Beta-One-Hf-Llava-Q4_K.gguf) and the mmproj (Llama-Joycaption-Beta-One-Hf-Llava-F16.gguf)
|
| 7 |
+
- Launch KoboldCpp and go to Loaded Files tab
|
| 8 |
+
- Select the main model as "Text Model" and the mmproj as "Vision mmproj"
|