A tip how to make it think in llama-cli - syntax

#1
by Manamama - opened

You add the instructions in -sys bit (works in llama-cli, does not work in llama-mtmd-cli and maybe in other llamas - you then need to play with adding it to the -p field): -sys "You are a coding assistant tasked with analyzing Python programming puzzles. Provide a clear, concise explanation focusing on the underlying coding concept. Structure your response with reasoning in <think> </think> tags, followed by the final answer in <answer> </answer> tags

See initial experiments and details here: https://github.com/LeapLabTHU/Absolute-Zero-Reasoner/issues/23

Sign up or log in to comment