Skip to content

Commit

Permalink
📃 docs(aris-ai): add aris ai model server into change log
Browse files Browse the repository at this point in the history
  • Loading branch information
hcd233 committed Jul 13, 2024
1 parent f2f3444 commit 436e1ff
Show file tree
Hide file tree
Showing 2 changed files with 6 additions and 2 deletions.
2 changes: 2 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -17,6 +17,8 @@ This is a project that provides **private large language model services**, aimin

## Change Log

- [2024-07-13] We open source the [Aris-AI-Model-Server](https//github.com/hcd233/Aris-AI-Model-Server), which integrates LLM, Embedding and Reranker deployment services, and provides an OpenAI Compatible API interface to facilitate users to deploy private models.

- [2024-06-23] We release the [Aris-14B-Chat Series Model](https://huggingface.co/collections/Aris-AI/aris-chat-arcturus-6642fd11069310a4467db222) which sft and dpo by [Qwen1.5-14B-Chat](https://huggingface.co/Qwen/Qwen1.5-14B-Chat) on our private dataset. Please obey the qwen open source agreement while using it.

- [2024-06-15] Use Neo4j as the database for storing knowledge bases
Expand Down
6 changes: 4 additions & 2 deletions README_zh.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@

## 介绍

这是一个提供**私有化大语言模型服务**的项目,目的是为了快速接入通用大模型(GPT3.5、GPT4)和私有模型(Qwen1.5、ChatGLM3、LLama2、Baichuan2等)服务,提供统一的API接口。依托langchain框架提供多轮对话(Chat)和检索增强生成(RAG)服务,项目名来源于Blue Archive中的角色Aris,如下图
这是一个提供**私有化大语言模型服务**的项目,目的是为了快速接入通用大模型(GPT3.5、GPT4)和私有模型(Qwen1.5、ChatGLM3、LLama2、Baichuan2等)服务,提供统一的API接口。依托langchain框架提供多轮对话(Chat)和检索增强生成(RAG)服务,

---

Expand All @@ -17,6 +17,8 @@

## 更新日志

- [2024-07-13] 我们开源了[Aris-AI-Model-Server](https://github.com/hcd233/Aris-AI-Model-Server),集成了LLM、Embedding、Reranker等模型部署服务,提供OpenAI Compatible API接口以方便用户进行私有模型部署。

- [2024-06-23] 我们发布了[Aris-14B-Chat系列模型](https://huggingface.co/collections/Aris-AI/aris-chat-arcturus-6642fd11069310a4467db222),该模型基于[Qwen1.5-14B-Chat](https://huggingface.co/Qwen/Qwen1.5-14B-Chat)在我们的140K条私有数据集进行了SFT和DPO。在使用该模型时,请遵守Qwen开源协议。

- [2024-06-15] 使用Neo4j作为存储知识库的数据库
Expand Down Expand Up @@ -193,7 +195,7 @@ docker-compose -f docker/deployment/docker-compose.yml up -d --no-build
#### 模型操作

1. 调用通用大模型服务,目前仅支持OpenAI系列模型(或类OpenAI接口的代理),直接在API中接入即可,需要在数据库中储存base、key、max_tokens等信息,同时可以自定义System prompt
2. 调用私有模型服务,请先把模型部署成类OpenAI接口的API服务(例如[llama-cpp-python](https://github.com/abetlen/llama-cpp-python)),然后按照第一条的操作即可
2. 调用私有模型服务,请先把模型部署成类OpenAI接口的API服务(可以使用[Aris-AI-Model-Server](https://github.com/hcd233/Aris-AI-Model-Server),进行相应配置。

## 项目展望

Expand Down

0 comments on commit 436e1ff

Please sign in to comment.