Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature] AI suggested adding VLLM support. #7929

Open
Anyexyz opened this issue Feb 20, 2025 · 1 comment
Open

[Feature] AI suggested adding VLLM support. #7929

Anyexyz opened this issue Feb 20, 2025 · 1 comment
Assignees
@wanghe-fit2cloud
Labels
Type: Feature Request

Comments

@Anyexyz
Copy link
Contributor

Anyexyz commented Feb 20, 2025

1Panel Version

v1.10.25-beta.1

Please describe your needs or suggestions for improvements

The current AI module only supports Ollama. However, in a production environment, vllm may be more commonly used and have better performance. It is recommended to add support for vllm.

Image

Please describe the solution you suggest

No response

Additional Information

No response
@wanghe-fit2cloud
Copy link
Member

Thank you for the feedback. We will consider supporting this request in a future version.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@wanghe-fit2cloud wanghe-fit2cloud

Labels
Type: Feature Request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@wanghe-fit2cloud @Anyexyz