Skip to content

Commit

Permalink
Add warning for Qwen2.5 compatibility in README files
Browse files Browse the repository at this point in the history
  • Loading branch information
Jacob-Zhou committed Dec 26, 2024
1 parent ae2b2ae commit 5302785
Show file tree
Hide file tree
Showing 2 changed files with 18 additions and 0 deletions.
9 changes: 9 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -61,6 +61,15 @@ For better performance, you can install flash-attn:
pip install flash-attn --no-build-isolation
```

<!-- Add a warning about Qwen2.5 -->

> [!WARNING]
> Reported by a user, using Qwen2.5 family models without flash-attn will lead unexpected errors.
>
> Please install flash-attn to avoid this issue.
>
> We are working on a fix for this issue, making it compatible with Qwen2.5 family without flash-attn.
## Usage

### Model Preparation
Expand Down
9 changes: 9 additions & 0 deletions README.zh.md
Original file line number Diff line number Diff line change
Expand Up @@ -61,6 +61,15 @@ bash scripts/set_enviroment.sh
pip install flash-attn --no-build-isolation
```

<!-- Add a warning about Qwen2.5 -->

> [!WARNING]
> 一位用户报告说,使用 Qwen2.5 系列模型时,如果没有安装 flash-attn,代码会产生意料之外的行为。
>
> 因此如在本代码库中使用 Qwen2.5 系列模型,请务必安装 flash-attn。
>
> 同时我们正在努力解决这个问题,使未安装 flash-attn 的用户也能正常使用 Qwen2.5 系列模型。
## 使用方法

### 模型准备
Expand Down

0 comments on commit 5302785

Please sign in to comment.