Mixing streaming and tool use

[efritz]

When I enable streaming it seems that the tool use JSON payload is sent as part of the content field of the ChatResponse value and tool_calls remains empty. Disabling streaming for the same model/prompt populates this array as I'd expect.

Is there a way to enable the same parsing with streaming enabled (or, alternatively a guide on how to consistently parse a tool use from the streaming model response)?

[BruceMacD]

Hey @efritz, this is a limitation on tool use with the latest version of Ollama. There is a fix open in the main repository now:
ollama/ollama#6066

I'll keep this issue open to track when this gets merged into the JavaScript SDK.

[nbonamy]

Hi @BruceMacD any updates on this one? Thanks!