System_message_composition

[ferenci84]

Description

Continuation of #4506

Replacement of #3787

On top of PR 4506 it adds experimental configuration systemMessageComposition. Changed documentation explains how it works.

Legacy logic remains working if user do not change the configuration.

Checklist

• The relevant docs, if any, have been updated or created
• The relevant tests, if any, have been updated or created

Screenshots

[ For visual changes, include screenshots. ]

Testing instructions

Experiment with config:

  "experimental": {
    "systemMessageComposition": "prepend"
  }

In the model description, you can also set:

     "promptTemplates": {
        "codeBlockInstructions": "My own instructions for code blocks",
        "toolUseRules": "My tool use rules"
      },

[netlify]

✅ Deploy Preview for continuedev canceled.

Name	Link
🔨 Latest commit	89329af
🔍 Latest deploy log	https://app.netlify.com/sites/continuedev/deploys/67c976d6cc11b3000807d045

[sammyvoncheese]

very cool change, I have been looking at doing something similar to customize/override all of the hidden system messages sent with each request.