We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Options
Currently ollama-js has the following option types:
ollama-js
export interface Options { numa: boolean num_ctx: number num_batch: number num_gpu: number main_gpu: number low_vram: boolean f16_kv: boolean logits_all: boolean vocab_only: boolean use_mmap: boolean use_mlock: boolean embedding_only: boolean num_thread: number // Runtime options num_keep: number seed: number num_predict: number top_k: number top_p: number tfs_z: number typical_p: number repeat_last_n: number temperature: number repeat_penalty: number presence_penalty: number frequency_penalty: number mirostat: number mirostat_tau: number mirostat_eta: number penalize_newline: boolean stop: string[] }
When compared to the parameters listed in API.md:
API.md
min_p
embedding_only
logits_all
This appears to also be the case with the Python library.
I'd be happy to issue PRs for both libraries if someone can confirm which parameters should be supported by each of them.
The text was updated successfully, but these errors were encountered:
chore: update types for OllamaOptions
72559ce
REF ollama/ollama-js#145
No branches or pull requests
Currently
ollama-js
has the following option types:When compared to the parameters listed in
API.md
:min_p
is missing fromOptions
embedding_only
andlogits_all
is present inOptions
but missing inAPI.md
This appears to also be the case with the Python library.
I'd be happy to issue PRs for both libraries if someone can confirm which parameters should be supported by each of them.
The text was updated successfully, but these errors were encountered: