Update README.md
Browse files
README.md
CHANGED
@@ -30,7 +30,9 @@ Support is also expected to come to llama.cpp, however work is still being done
|
|
30 |
|
31 |
To use the increased context with KoboldCpp, use `--contextsize` to set the desired context, eg `--contextsize 4096` or `--contextsize 8192` or `--contextsize 16384`.
|
32 |
|
33 |
-
**NOTE**:
|
|
|
|
|
34 |
|
35 |
## Repositories available
|
36 |
|
|
|
30 |
|
31 |
To use the increased context with KoboldCpp, use `--contextsize` to set the desired context, eg `--contextsize 4096` or `--contextsize 8192` or `--contextsize 16384`.
|
32 |
|
33 |
+
**NOTE 1**: Currently RoPE models can _only_ be used at a context size greater than 2048. At 2048 it will produce gibberish. Please make sure you're always setting `--contextsize` and specifying a value higher than 2048, eg 3072, 4096, etc.
|
34 |
+
|
35 |
+
**NOTE 2**: Increased context length is an area seeing rapid developments and improvements. It is quite possible that these models may be superseded by new developments in the coming days. If that's the case, I will remove them, or update this README as appropriate.
|
36 |
|
37 |
## Repositories available
|
38 |
|