Skip to content

Commit

Permalink
Merge branch 'simple-mla' of github.com:lzhangzz/lmdeploy into simple…
Browse files Browse the repository at this point in the history
…-mla
  • Loading branch information
lzhangzz committed Nov 26, 2024
2 parents 4d71007 + 8169e97 commit 9b1a82b
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions autotest/config.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -62,6 +62,7 @@ turbomind_chat_model:
- liuhaotian/llava-v1.6-vicuna-7b
- deepseek-ai/deepseek-vl-1.3b-chat
- deepseek-ai/deepseek-coder-1.3b-instruct
- deepseek-ai/DeepSeek-V2-Lite-Chat
- codellama/CodeLlama-7b-Instruct-hf
- THUDM/glm-4-9b-chat
- openbmb/MiniCPM-Llama3-V-2_5
Expand Down Expand Up @@ -167,6 +168,7 @@ turbomind_quatization:
- Qwen/Qwen2-VL-7B-Instruct
- mistralai/Mistral-7B-Instruct-v0.3
- deepseek-ai/deepseek-coder-1.3b-instruct
- deepseek-ai/DeepSeek-V2-Lite-Chat
- codellama/CodeLlama-7b-Instruct-hf
gptq:
- internlm/internlm2_5-7b-chat
Expand Down

0 comments on commit 9b1a82b

Please sign in to comment.