Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

/v1/completions prompt输入无效 #2572

Open
1 of 3 tasks
alvinlee518 opened this issue Nov 22, 2024 · 1 comment
Open
1 of 3 tasks

/v1/completions prompt输入无效 #2572

alvinlee518 opened this issue Nov 22, 2024 · 1 comment
Labels
gpu
Milestone
v0.16

Comments

@alvinlee518
Copy link

System Info / 系統信息

release '24.04.1 LTS'

Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece？

  • docker / docker
  • pip install / 通过 pip install 安装
  • installation from source / 从源码安装

Version info / 版本信息

CPU Info Usage: 0.04Total: 8.00
CPU Memory Info Usage: 5189.59MiBTotal: 29692.38MiB
GPU Info Total: 1.00
GPU Memory Info Usage: 5868.06MiBTotal: 23028.00MiB
Version Release: v0.16.3Commit: 85ab86bf1c0967e45fbec995534cd5a0c9a9c439

The command used to start Xinference / 用以启动 xinference 的命令

通过pip install --upgrade "xinference[all]"执行升级到版本v0.16.3

Reproduction / 复现过程

image
image

无论输入任何提示词都只返回模型的自我介绍网页上模拟是正常的

Expected behavior / 期待表现

不同的提示词能有不同表现
@XprobeBot XprobeBot added the gpu label Nov 22, 2024
@XprobeBot XprobeBot added this to the v0.16 milestone Nov 22, 2024
@alvinlee518
Copy link
Author

image
更换模型后也不行

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
gpu
Projects
None yet
Milestone
v0.16
Development

No branches or pull requests
2 participants
@alvinlee518 @XprobeBot