You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Smaller Ollama models (below 32B parameters) are failing to properly handle function calling, causing loops and hallucinations in the summarization process.
Impact
Users with limited resources cannot use smaller models
Inconsistent behavior with different model sizes
Poor summarization quality with smaller models
Acceptance Criteria
Identify minimum model requirements
Add model compatibility checking
Clear error messages for incompatible models
Documentation of supported models
Fallback options for lower-resource systems
Priority
Medium - Affects subset of users using smaller models
The text was updated successfully, but these errors were encountered:
Description
Smaller Ollama models (below 32B parameters) are failing to properly handle function calling, causing loops and hallucinations in the summarization process.
Impact
Acceptance Criteria
Priority
Medium - Affects subset of users using smaller models
The text was updated successfully, but these errors were encountered: