How to limit the length of the answer

[OswaldoBornemann]

I would like to limit the length of the answer (response). And I have tried to add the instruction using with_instructions inside the signature. However, it seems not worked.

[OswaldoBornemann]

How to modify the system prompt, like I want to insert the task description at the beginning of the system prompt.

[kuyu12]

I’m fairly certain that using with_instructions will append your instructions to the system prompt.

So if you want to limit the response length or add a task description at the beginning of the prompt, wrapping your Signature with with_instructions should inject those instructions into the system prompt that the model receives.

[OswaldoBornemann]

Yeah I found this as well. But I found that adding with with_instructions has any positive affects.

After debugging the code, I found that dspy did not place the task_description in the beginning of the prompt. After placing the task_description in the beginning, the performance seems more reasonable.

[torchss]

You can write a custom adapter that places the pieces where you want but has this now addressed your usecase? I ask because if not, a proper, more robust solution would be writing your custom logit processor. There's some related discussion: #8580