xiaol commited on
Commit
3dea359
·
1 Parent(s): 6d76429

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -0
README.md CHANGED
@@ -18,6 +18,20 @@ remove eod, add special token, change vocabs.
18
 
19
  this model is used to QA in large texts, do some in context learning with knowledge indexed database.
20
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
21
  --------------------------------------------
22
  if wanna test this model ,some effort needed, copy back-python folder to a new one ,which is in the same folder with rwkv runner exe file , then past rwkv_vocab_v20230424.txt into rwkv_pip folder to replace the vocabs file
23
 
 
18
 
19
  this model is used to QA in large texts, do some in context learning with knowledge indexed database.
20
 
21
+
22
+ ## trainning details
23
+
24
+ train with this kind of format,
25
+
26
+ <s>User: <sys>xxxx\n\n</sys>xxxxx</s><s>Assistant: xxxxx\n\n</s><s>User: xxxx\n\n</s><s>Assistant: \n\n</s>
27
+
28
+ so ,use User Assistant as your prefix names.
29
+ and when inference in RWKV runner, just use the following format is fine.
30
+
31
+ User: xxxx\n\nAssistant: xxxx\n\n,wnich are the test cases used.
32
+
33
+ you can see Generalization ablility is great in this model
34
+
35
  --------------------------------------------
36
  if wanna test this model ,some effort needed, copy back-python folder to a new one ,which is in the same folder with rwkv runner exe file , then past rwkv_vocab_v20230424.txt into rwkv_pip folder to replace the vocabs file
37