What is the system prompt? (Usage)
#3
by
houmie
- opened
Hello, I still use Text Generation instead of Chat Generation.
What is the syntax that this model was trained on? Based on the model card it seems to be using the DeepSeek 2.5 syntax instead of the Llama3 syntax. Am I right?
DeepSeek 2.5:
<｜begin▁of▁sentence｜><｜User｜>{user_message_1}<｜Assistant｜>{assistant_message_1}<｜end▁of▁sentence｜><｜User｜>{user_message_2}<｜Assistant｜>
<｜begin▁of▁sentence｜>{system_message}<｜User｜>{user_message_1}<｜Assistant｜>{assistant_message_1}<｜end▁of▁sentence｜><｜User｜>{user_message_2}<｜Assistant｜>
Why is there <｜end▁of▁sentence｜> signalling the end of the sentence and yet it continues with <｜User｜>{user_message_2}<｜Assistant｜> ?
Thank you