Update README.md
Browse files
README.md
CHANGED
@@ -18,6 +18,20 @@ remove eod, add special token, change vocabs.
|
|
18 |
|
19 |
this model is used to QA in large texts, do some in context learning with knowledge indexed database.
|
20 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
21 |
--------------------------------------------
|
22 |
if wanna test this model ,some effort needed, copy back-python folder to a new one ,which is in the same folder with rwkv runner exe file , then past rwkv_vocab_v20230424.txt into rwkv_pip folder to replace the vocabs file
|
23 |
|
|
|
18 |
|
19 |
this model is used to QA in large texts, do some in context learning with knowledge indexed database.
|
20 |
|
21 |
+
|
22 |
+
## trainning details
|
23 |
+
|
24 |
+
train with this kind of format,
|
25 |
+
|
26 |
+
<s>User: <sys>xxxx\n\n</sys>xxxxx</s><s>Assistant: xxxxx\n\n</s><s>User: xxxx\n\n</s><s>Assistant: \n\n</s>
|
27 |
+
|
28 |
+
so ,use User Assistant as your prefix names.
|
29 |
+
and when inference in RWKV runner, just use the following format is fine.
|
30 |
+
|
31 |
+
User: xxxx\n\nAssistant: xxxx\n\n,wnich are the test cases used.
|
32 |
+
|
33 |
+
you can see Generalization ablility is great in this model
|
34 |
+
|
35 |
--------------------------------------------
|
36 |
if wanna test this model ,some effort needed, copy back-python folder to a new one ,which is in the same folder with rwkv runner exe file , then past rwkv_vocab_v20230424.txt into rwkv_pip folder to replace the vocabs file
|
37 |
|