Ollama Chat Completion not invoking plugin functions

[eeadie]

Hi,

I have been investigating using Ollama chat completion. I am struggling to get plugin functions to exectue when using Ollama chat completion. Everything works as expected when using AzureOpenAIChatCompletion.

Is invoking of plugin functions supported with OllamaChatCompletion?

Thanks,

Euan

[eeadie]

Example project I am testing with:

SemanticKernelLightBlub.zip

[sophialagerkranspandey]

Thanks for reaching out, we are currently working on this. I'm tagging @RogerBarreto @RogerBarret0 to elaborate.

[RogerBarreto]

@eeadie Currently our Ollama dedicated connector doesn't support function calling.

We have the PR below adding that support for our Ollama Connector, keep posted, potentially available in our next release.

• .Net: MS AI Ollama with Function calling #9488

[frazur]

Hi @RogerBarreto,
I'm trying to use the Ollama chat completion with llama3.2 [edit] with auto function call [/edit] but I see a different behavior than GPT4.
Just to make you understand, let's say my plugin is Weather(city_name, day) and the query is "Tell me what the weather is like in Rome tomorrow"

• with GPT4, the behavior is that the model understands the parameters, understands what the plugin is, invokes it and returns "tomorrow in Rome it will be partly cloudy"
• with Ollama + Llama3.2, the result is "name:Weather-plugin, parameters {city_name:Rome, day:tomorrow}", that is, it recognizes plugin and parameters, but does not perform the invocation.

So it seems like something is missing. Any suggestion?

[tomfanara]

Hi I am having this issue too any release date on this enhancement?