Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for Ollama tool usage to Home Models #245

Open
StrandmonYellow opened this issue Jan 26, 2025 · 1 comment
Open

Add support for Ollama tool usage to Home Models #245

StrandmonYellow opened this issue Jan 26, 2025 · 1 comment
Labels
enhancement New feature or request

Comments

@StrandmonYellow
Copy link

Bug:
So I am running a docker compose instance on my NAS, running ollama using openwebUI. I downloaded you model from huggingface using the command:

ollama run hf.co/acon96/Home-1B-v3-GGUF:Q4_K_M

It downloaded the model succesfully. Now I can talk to it using the openwebUI frontend:

Image

I am able to connect to the model using the ollama integration on my home assistant yellow. I can now ask it questions using my home assistant instance:

Image

However, as soon as I set the conversation agent to be able to control my devices:

Image

Then I get this response:

Sorry, I had a problem talking to the Ollama server: hf.co/acon96/Home-1B-v3-GGUF:Q4_K_M does not support tools

Expected behavior:
I expect the model to answer the command, and execute the command by controlling my devices.

Logs:
I think the response speaks for itself, but if any logs are needed, please say so.

Home assistant version:
core: 2025.1.4
supervisor: 2024.12.3

Ollama version: 0.5.7

@StrandmonYellow StrandmonYellow added the bug Something isn't working label Jan 26, 2025
@acon96
Copy link
Owner

acon96 commented Jan 26, 2025

The Home models actually predate tool support in Ollama. That means they only work with the extension provided in this repo (Local LLM Conversation) and not the built in Home Assistant Ollama extension, which relies on tool support.

I'm converting this into a feature request because it would be good to support Ollama tool usage natively.

@acon96 acon96 added enhancement New feature or request and removed bug Something isn't working labels Jan 26, 2025
@acon96 acon96 changed the title Model does not support tools error HA using Ollama Add support for Ollama tool usage to Home Models Jan 26, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants