Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Openrouter reasoning support #4672

Closed

Conversation

SpeedCrash100
Copy link

Description

Added initial support of thinking retrieval from Openrouter.

Currently. It is required to set up extraBodyProperties and provider correctly:

Deepseek is working, but some models may not return reasoning even if they are thinking. Can be verified with curl.

# Note: openai here, idk why, but with `openrouter` it will not work
  - provider: openai
    apiBase: https://openrouter.ai/api/v1
    apiKey: sk-*
    name: Openrouter Deepseek R1 FREE
    model: deepseek/deepseek-r1:free
    requestOptions:
      extraBodyProperties:
        stream: true
        include_reasoning: true

Checklist

  • [] The relevant docs, if any, have been updated or created
  • [] The relevant tests, if any, have been updated or created

Screenshots

изображение
изображение

Testing instructions

  1. set up config.yaml to use openrouter DeepSeek R1 model and add extraBodyProperties: from Description section.
  2. Send chat request and ensure the Thinking... section appeared
  3. It should be tested that Ollama Deepseek R1 still working.

Copy link

netlify bot commented Mar 16, 2025

Deploy Preview for continuedev canceled.

Name Link
🔨 Latest commit f2c9480
🔍 Latest deploy log https://app.netlify.com/sites/continuedev/deploys/67d6b5164c1adb00089fe139

@SpeedCrash100
Copy link
Author

Will wait for #4559 might be handled here already

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant