Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tensorflow_model_server_neuron missing in DLAMI #1069

Open
kainoj opened this issue Dec 18, 2024 · 1 comment
Open

tensorflow_model_server_neuron missing in DLAMI #1069

kainoj opened this issue Dec 18, 2024 · 1 comment
Labels
documentation Improvements or additions to documentation tensorflow-neuronx

Comments

@kainoj
Copy link

kainoj commented Dec 18, 2024

Documentation mentions that tf model server is pre-installed and located in /usr/local/bin/tensorflow_model_server_neuron. Unfortunately, it is nowhere to be found (one needs to install it manually).

Used AMI: amazon/Deep Learning AMI Neuron (Amazon Linux 2023) 20241025 (ami-0f59656a37d6b6fff)

Doc: https://awsdocs-neuron.readthedocs-hosted.com/en/latest/frameworks/tensorflow/tensorflow-neuronx/tutorials/tutorial-tensorflowx-serving-NeuronRT-Visible-Cores.html

@seanlatias seanlatias added documentation Improvements or additions to documentation tensorflow-neuronx labels Dec 18, 2024
@seanlatias
Copy link

Thanks for raising the issue! We will update the document.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation tensorflow-neuronx
Projects
None yet
Development

No branches or pull requests

2 participants