Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adapt to open LLMs #5

Open
cboettig opened this issue Dec 18, 2024 · 0 comments
Open

Adapt to open LLMs #5

cboettig opened this issue Dec 18, 2024 · 0 comments

Comments

@cboettig
Copy link
Member

not clear that we can get structured data responses from the open LLMs, so might require significant tweaking. Sometimes it looks like they can be instructed to use JSON format merely in the system prompt, and we just manually parse, but will probably require significant testing/fiddling ...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant