Force talking as user or assistant in SillyTavern
Hello! First of all, congrats on the impressive work on this model! It's a bit hard to handle at first, but damn it seems good! I was wondering, since the RP template uses "writer character" user and char, how do you talk as user or system to integrate some OOC message in there please? It's possibly a ST feature I'm not aware of... thank you!
EDIT! Just realized the SillyTavern part mentions the /sys command! My bad! I'm getting a small problem though, after sending a /sys message, when I click send for the next message, the character does not respond...
Hello! Glad you seem to like it :)
That's right /sys is for instructions (OOC) and the way ST handles it, you need to click the "send" (airplane) icon again after you add it.
I recorded a short demo as it's maybe easier (the action happens at the bottom -- the progress bar may obscure it):
That's odd, for me it just makes the system message one line bigger and doesn't generate anything! I'm using the provided templates and everything :(
Oh, that's strange! Could you maybe record it? Then we can ask Cohee or someone else on the ST discord. Maybe it's some setting? Actually, ideally, I would like /sys to start generating response right away without having to press the button again.
I can't record I think... but basically it's like it's hitting a stop sequence token instantly after pressing send to generate the next response. (it says EOS token triggered directly in the console with an empty output.)
Fixed! I had "Send" to Continue option enabled in my user settings for some reason, disabling it fixed it 😅
Damn this model is nice, I'm having a lot of fun with it. I'm wondering now though, I want to try a guided narrative... How can the AI use the "writer narrative" role mentioned in the system prompts please? It's always using writer character automatically...
@Varkoyote To change automatically between narrative and character is not possible with SillyTavern (at least not with my skill level -- maybe with some extension / plugin?)
BUT! I created a dedicated "only" writing preset: https://huggingface.co/dreamgen/lucid-v1-nemo#story-writing
You might need to adapt your card a bit to make it work well though.
I am attaching what it would look like for the model to automatically switch between characters and narrative in role-play mode: