Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Consider different ways to deploy LLM models #70

Open
Vl-Tershch opened this issue Dec 10, 2024 · 0 comments
Open

Consider different ways to deploy LLM models #70

Vl-Tershch opened this issue Dec 10, 2024 · 0 comments
Assignees
@Vl-Tershch
Labels
App Working with the application template
Milestone
Edulytica_2024_2025

Comments

@Vl-Tershch
Copy link
Collaborator

Задача: Рассмотреть различные способы деплоя LLM моделей.
В случае долгого инференса моделей проанализировать другие методы деплоя.

In case of long-term inference of models, analyze other deployment methods.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Vl-Tershch Vl-Tershch

Labels
App Working with the application template
Projects
None yet
Milestone
Edulytica_2024_2025
Development

No branches or pull requests
1 participant
@Vl-Tershch