Skip to content

gpt_server v0.3.1
Compare
Choose a tag to compare
@shell-nlp shell-nlp released this 28 Jul 15:40
· 53 commits to main since this release
v0.3.1
e8401f6

gpt_server v0.3.1

What's Changed

  1. 支持了Infinity后端，推理速度大于onnx/tensorrt，支持动态组批
  2. 支持了多模态模型 glm-4v-gb 的LMDeploy PyTorch后端 #11
  3. 优化了requirements #12
  4. 优化了配置文件的结构
Assets 2
Loading