Only 1 function call but expected multiple

[HuskyDanny]

Hi,

I have a scenario where the retrieval plugin will have different functions to get different data sources. I have an ChatCompletionAgent agent with the FunctionChoiceBehavior to be Auto, after I explicitly put in the instruction to fetch multiple data sources, the decided function call is only 1, how can I have multiple function calls running in parallel?

[moonbox3]

Hi @HuskyDanny, are the kernel functions that are supposed called semantically different enough so that the model knows that each should be invoked? The kernel functions are eventually turned into embeddings and if they are too similar, the model might not do a good job at distinguishing small differences. Otherwise, have you tried some prompt engineering to make sure the model knows if/when it invokes the functions it should be invoking N number of functions?

[HuskyDanny]

@moonbox3 Do we have guide on how to do the prompt engineering? I have put the instruction:

AGENT_INSTRUCTIONS = "You are an expert in converting natural language questions to SQL queries. Try to generate an executable query, you can find the database_entity by the text_memory_plugin, and you can also find the relevant examples which is a pair for question to sql in text_memory_plugin. Use those as the ground truth to generate the sql query"

which should be explicit enough right?