Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Multiple models with autocomplete role in config.yaml #4306

Open
masq6r opened this issue Feb 23, 2025 · 0 comments
Open

Multiple models with autocomplete role in config.yaml #4306

masq6r opened this issue Feb 23, 2025 · 0 comments
Assignees
Labels
area:configuration Relates to configuration options area:docs Relates to documentation kind:question Indicates a question "needs-triage"

Comments

@masq6r
Copy link

masq6r commented Feb 23, 2025

Issue Category

Undocumented feature or missing documentation

Affected Documentation Page URL

No response

Issue Description

How can I choose the autocomplete model when I define a few models that have autocomplete role, in config.yaml? For example:

models:

  - name: qwen-coder
    provider: openai
    model: qwen-coder-turbo
    apiKey: redacted
    apiBase: https://url
    defaultCompletionOptions:
      maxTokens: 500
    roles:
      - autocomplete

  - name: Codestral
    provider: mistral
    model: codestral-latest
    apiKey: redacted
    defaultCompletionOptions:
      maxTokens: 500
    roles:
      - autocomplete

Expected Content

No response

@masq6r masq6r added the area:docs Relates to documentation label Feb 23, 2025
@dosubot dosubot bot added area:configuration Relates to configuration options kind:question Indicates a question labels Feb 23, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:configuration Relates to configuration options area:docs Relates to documentation kind:question Indicates a question "needs-triage"
Projects
None yet
Development

No branches or pull requests

2 participants