User-Controlled Tool Execution using ChatClient

[davidbellem]

Dear Community,

I am new to Spring AI, so this might be a basic question, apologies for this:

I am trying to implement the User-Controlled Tool Execution as described in the documentation.

However, I use the ChatClient interface to define a few advisors (e.g. RAG, Query Augmentation). I can add the manual tool calling there as well

chatClient = builder.defaultAdvisors(...)
                        .defaultOptions(ToolCallingChatOptions.builder()
                                .internalToolExecutionEnabled(false) // User-controlled tool execution
                                .build())
                        .build();

Then I can build my prompt with tool calls and execute it

var prompt = chatClient
                .prompt(new Prompt())
                .system(s -> {
                    s.text("...");
                .user(u -> {
                    u.text("");
                })
                .advisors(a -> {
                    ...
                })
                .tools(new MyTools());

ChatResponse chatResponse = prompt.call().chatResponse();

My question is: Where can I get the promptWithMemory from in order to do the following from the documentation?

while (chatResponse.hasToolCalls()) {
   ToolExecutionResult toolExecutionResult = toolCallingManager.executeToolCalls(promptWithMemory,
            chatResponse);
    chatMemory.add(conversationId, toolExecutionResult.conversationHistory()
            .get(toolExecutionResult.conversationHistory().size() - 1));
    promptWithMemory = new Prompt(chatMemory.get(conversationId), chatOptions);
    chatResponse = chatModel.call(promptWithMemory);
    chatMemory.add(conversationId, chatResponse.getResult().getOutput());
}

Thank you very much for your help!

[davidbellem]

Saw that this is basically a duplicate of #2511