Skip to content

Commit

Permalink
Merge pull request #2 from mobiusml/update_aana_0.2.1
Browse files Browse the repository at this point in the history
Update Aana SDK version to 0.2.1
  • Loading branch information
movchan74 authored Jul 11, 2024
2 parents 6f36827 + 192dbc9 commit c89a0fc
Show file tree
Hide file tree
Showing 4 changed files with 23 additions and 16 deletions.
34 changes: 21 additions & 13 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -47,30 +47,38 @@ To install the project, follow these steps:

1. Clone the repository.

2. Install additional libraries.
2. Install the package with Poetry.

The project is managed with [Poetry](https://python-poetry.org/docs/). See the [Poetry installation instructions](https://python-poetry.org/docs/#installation) on how to install it on your system.

It will install the package and all dependencies in a virtual environment.

```bash
apt update && apt install -y libgl1
poetry install
```
> **🗒️ Note**
>
> For optimal performance, you should also install [PyTorch](https://pytorch.org/get-started/locally/) version >=2.1 appropriate for your system. You can continue directly to the next step, but it will install a default version that may not make optimal use of your system's resources, for example, a GPU or even some SIMD operations. Therefore we recommend choosing your PyTorch package carefully and installing it manually.

> **🗒️ Note**
>
> Some models use Flash Attention. Install Flash Attention library for better performance. See [flash attention installation instructions](https://github.com/Dao-AILab/flash-attention?tab=readme-ov-file#installation-and-features) for more details and supported GPUs.
3. Install additional libraries.

3. Install the package with poetry.
For optimal performance, you should also install [PyTorch](https://pytorch.org/get-started/locally/) version >=2.1 appropriate for your system. You can continue directly to the next step, but it will install a default version that may not make optimal use of your system's resources, for example, a GPU or even some SIMD operations. Therefore we recommend choosing your PyTorch package carefully and installing it manually.

The project is managed with [Poetry](https://python-poetry.org/docs/). See the [Poetry installation instructions](https://python-poetry.org/docs/#installation) on how to install it on your system.
Some models use Flash Attention. Install Flash Attention library for better performance. See [flash attention installation instructions](https://github.com/Dao-AILab/flash-attention?tab=readme-ov-file#installation-and-features) for more details and supported GPUs.

It will install the package and all dependencies in a virtual environment.

4. Activate the Poetry environment.

To activate the Poetry environment, run the following command:

```bash
poetry install
poetry shell
```

Alternatively, you can run commands in the Poetry environment by prefixing them with `poetry run`. For example:

```bash
poetry run aana deploy aana_app_project.app:aana_app
```

4. Run the app.
5. Run the app.

```bash
aana deploy aana_app_project.app:aana_app
Expand Down
Empty file.
2 changes: 1 addition & 1 deletion aana_app_project/core/prompts/loader.py
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,6 @@ def get_prompt_template(name: str) -> Template:
Template: The prompt template.
"""
env = Environment(loader=PackageLoader(
"aana_app_project", "core", "prompts"))
"aana_app_project.core", "prompts"))
template = env.get_template(f"{name}.j2")
return template
3 changes: 1 addition & 2 deletions pyproject.toml
Original file line number Diff line number Diff line change
Expand Up @@ -7,8 +7,7 @@ readme = "README.md"

[tool.poetry.dependencies]
python = "^3.10"
aana = ">=0.2.0"

aana = ">=0.2.1"

[tool.poetry.group.dev.dependencies]
ipykernel = "^6.29.4"
Expand Down

0 comments on commit c89a0fc

Please sign in to comment.