New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Test] Build vllm image to test prefix caching #12447

Open

hzjane wants to merge 1 commit into intel-analytics:main from hzjane:Test_build_vllm_docker

Contributor

hzjane commented Nov 26, 2024

Description

[Test] Build vllm image to test prefix caching

1. Why the change?

2. User API changes

3. Summary of the change

4. How to test?

N/A
Unit test: Please manually trigger the PR Validation here by inputting the PR number (e.g., 1234). And paste your action link here once it has been successfully finished.
Application test
Document test
...

5. New dependencies

New Python dependencies
- Dependency1
- Dependency2
- ...
New Java/Scala dependencies and their license
- Dependency1 and license1
- Dependency2 and license2
- ...


          build image to test prefix caching

66997b9

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet