Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

unable add rerank model when using GPUStack #14069

Open
5 tasks done
liuw518 opened this issue Feb 20, 2025 · 1 comment
Open
5 tasks done

unable add rerank model when using GPUStack #14069

liuw518 opened this issue Feb 20, 2025 · 1 comment
Labels

Comments

@liuw518
Copy link

liuw518 commented Feb 20, 2025

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

0.15.1

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

when add rerank model under GPUStack,occur 400 error.
Image
In GPUStack, test rerank service and api is OK

Image

✔️ Expected Behavior

can add rerank models normally

❌ Actual Behavior

http 400 error

@dosubot dosubot bot added the 🐞 bug Something isn't working label Feb 20, 2025
Copy link

dosubot bot commented Feb 20, 2025

@liuw518 Hello there! I'm here to help you with any bugs, questions, or contributions you have for the project. Let's tackle this issue together!

A 400 error when adding a rerank model in Dify can often be caused by using the 'raw' body format in the HTTP request node when the query contains special characters like newlines ('\n'). To resolve this, ensure that the body format is set to 'JSON' in the HTTP request node configuration to properly escape special characters in the query string. Additionally, since you are using Dify version 0.15.1, make sure that your setup is compatible with GPUStack, as there might be specific configurations required for this integration that are not detailed in the available documentation [1][2].

To continue talking to Dosu, mention @dosu.


Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants