You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Install Python 3.10.11
Download and install [Microsoft] (https://www.microsoft.com/en-us/download/details.aspx?id=57467) MPI. You will be prompted to choose between an exe, which installs the MPI executable, and an msi, which installs the MPI SDK. Download and install both
Install TensorRT-LLM wheel. Please take the wheel(tensorrt_llm-0.9.0-cp310-cp310-win_amd64.whl) from [here](https://github.com/NVIDIA/ChatRTX/tree/release/0.4.0/ChatRTX_APIs/dist).
cd wheel
pip install tensorrt_llm-0.9.0-cp310-cp310-win_amd64.whl --extra-index-url https://pypi.nvidia.com --extra-index-url https://download.pytorch.org/whl/cu121
Download and install 'ngcsdk-3.41.2-py3-none-any.whl' from [here](https://catalog.canary.ngc.nvidia.com/orgs/nvidia/teams/ngc-apps/resources/ngc_sdk/files?version=3.41.2) and install it using the command below. This enables us to download from NGC:
pip install .\ngcsdk-3.41.2-py3-none-any.whl
Download and install the ChatRTX API SDK present in the dist directory
pip install ChatRTX-0.4.0-py3-none-any.whl
Note: This project will download and install additional third-party open source software projects. Review the license terms of these open source projects before use.
I have the Chatrtx installed on my windows that is running a docker container and i want to acess the rtx api via python in the container, how should i follow the instructions? where do i install the pyhon and mpi?
where do i cd to wheel and for what? where do i pip install things, on windows, on container? on both?
The text was updated successfully, but these errors were encountered:
i was reading the docs :
I have the Chatrtx installed on my windows that is running a docker container and i want to acess the rtx api via python in the container, how should i follow the instructions? where do i install the pyhon and mpi?
where do i cd to wheel and for what? where do i pip install things, on windows, on container? on both?
The text was updated successfully, but these errors were encountered: