How to force invoke a plugin

[Skyquek]

[Issue]
I want to invoke a plugin that can help me to generate graph in JSON format. However, I am facing problem where sometimes the plugin is invoked, sometimes it don't (hallucinate). I am using AutoInvokeKernelFunction.

I am checking here what should I do in order to make sure my plugins always get invoked?

Thanks!

[moonbox3]

You can use the Required FunctionChoiceBehavior (or its equivalent depending upon the AI service). This tells the model it must make a tool call every time. The Required settings is a bit tricky, though. You will need to figure out how many "auto invoke attempts" to configure, as each time you call the LLM it will only respond with a tool call (no need to waste tokens continuously calling the same function).

[HuskyDanny]

Hi @moonbox3 , I am confused with the part "as each time you call the LLM it will only respond with a tool call", does this mean with Required, the llm will not return any content but only the tool call?

So this behavior is different from Auto? My scenario is to have the chat function always call one of the functions, so setting the functionChoiceBehavior as required.

[moonbox3]

Hello @HuskyDanny, yes, that is correct. If your FunctionChoiceBehavior is configured as Required, the model _will only make a tool call. You would need to have logic to control if you want to change the function choice behavior so the model can use any FunctionResultContent to form a final response, at some point.

Do all keep in mind that OpenAI models allow one to send multiple Required tools; however, Azure OpenAI only allows for one Required tool at a time. (I need to check if/when they will support multiple as OpenAI does.)