Skip to content

Issues: xorbitsai/inference

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

131 Open 1,537 Closed
131 Open 1,537 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

请问，一张卡为什么无法加载多个模型？ feature gpu
#2893 opened Feb 19, 2025 by Jimmy-L99 v1.x
xinference 能否支持将一个模型推到多机上做推理？ feature
#2892 opened Feb 19, 2025 by rainforu v1.x
ERROR: failed to solve: process "/bin/sh -c pip install --upgrade -i \"$PIP_INDEX\" pip && pip install -i \"$PIP_INDEX\" \"diskcache>=5.6.1\"
#2891 opened Feb 19, 2025 by watch-Ultra v1.x
1
新增电信的telechat2系列模型
#2888 opened Feb 19, 2025 by Kestrong v1.x
deepseek-r1-qwen xinference 发布后，在测试界面报错 gpu
#2885 opened Feb 19, 2025 by SharkSyl
1 of 3 tasks
v1.x
2
deepseek qwen 14b 响应超时时间
#2882 opened Feb 18, 2025 by SeesawLiu
1 of 3 tasks
v1.x
2
Qwen2.5-VL-7B-Instruct Error occurred during conversation gpu
#2880 opened Feb 18, 2025 by charliboy
1 of 3 tasks
v1.x
3
FEAT: support SeaLLMs-v3 feature help wanted Extra attention is needed
#2879 opened Feb 18, 2025 by elepherai v1.x
xinference 部署deepseek-r1模型报Model not found
#2875 opened Feb 18, 2025 by lanqy123
1 of 3 tasks
v1.x
2
自定义deepseek-r1-distill-qwen，遇到错误：Model not found gpu
#2874 opened Feb 18, 2025 by lordk911
1 of 3 tasks
v1.x
1
v1.2.2不支持Cuda 12.2，什么版本才支持12.2版本的cuda？ gpu
#2873 opened Feb 17, 2025 by icewizardry v1.x
2
申请支持AIDC-AI/Ovis2-34B多模态大模型 feature help wanted Extra attention is needed
#2870 opened Feb 15, 2025 by moshilangzi v1.x
申请支持Qwen2.5-VL-72B-Instruct-unsloth-bnb-4bit feature help wanted Extra attention is needed
#2869 opened Feb 15, 2025 by moshilangzi v1.x
申请支持internvl2.7-78B系列模型，VLLM推理 feature
#2868 opened Feb 15, 2025 by moshilangzi v1.x
1
libcuda.so.1: cannot open shared object file: No such file or directory gpu
#2865 opened Feb 15, 2025 by 13555957595 v1.x
3
CPU下启动Qwen2.5-VL-72B-instruct失败 gpu
#2863 opened Feb 15, 2025 by leoterry-ulrica
1 of 3 tasks
v1.x
2
deepseek-r1-distill-qwen-1.5b-awq输出字符会截断 ，大概1000字左右就会截断
#2862 opened Feb 14, 2025 by worm128 v1.x
8
用deepseek-coder-instruct聊天模板注册的DeepSeek-Coder-V2-Lite-Instruct模型给出的代码在聊天界面会出现&quot，代表“，但是如果用post得到的代码就不会 gpu
#2861 opened Feb 14, 2025 by MOON1234567890A
1 of 3 tasks
v1.x
1
加载deepseek r1 70b量化模型失败 gpu
#2860 opened Feb 14, 2025 by shatang123
1 of 3 tasks
v1.x
2
加载模型后点击聊天不显示聊天界面
#2859 opened Feb 14, 2025 by Lihwnlp v1.x
llama引擎运行deepseek-r1-qwen模型报错
#2858 opened Feb 13, 2025 by narutoPro v1.x
1
Randomly distribute traffic across multiple workers of the same model feature
#2857 opened Feb 13, 2025 by LinJianping v1.x
9
add api/chat for fitting ollama
#2856 opened Feb 13, 2025 by songqiangchina
1 of 3 tasks
v1.x
1
加载本地embedding模型文件出错 gpu
#2855 opened Feb 13, 2025 by Tiaonmmn
1 of 3 tasks
v1.x
Deepspeek-v3-awq自定义注册时Chat Template报错，注册后只能选择Transformers
#2854 opened Feb 13, 2025 by rexjm v1.x
4
ProTip! Updated in the last three days: updated:>2025-02-16.