About system prompt
#3
by
weiminw
- opened
As the model card says: Do not include system prompts when using chat templates. , but I used LLM to generate some response with some system prompt (include critical rules). how can I use this reward model to eval the response? Should I put the system prompt into user prompt or something else, could you give me some advice. great thanks to you!
Yes, it's fine if the system prompt accompanies the conversation. However, we want to note that there are not many instances of the training data with a system prompt, so we haven't extensively tested this scenario.
We initially intended to convey that you should not add a system prompt describing the evaluation task. We apologize for the confusion.