New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

能支持本地模型吗？ #37

Open

xiezhipeng-git opened this issue Nov 8, 2024 · 0 comments

xiezhipeng-git commented Nov 8, 2024

比如支持直接使用transfomer 本地模型使用openai api方式
以及vllm ollm等第三方
现在vllm本身支持openai的api 。但是有bug 7B模型不知道为什么不行，0.5B的可以

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment