Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

build: Support rebuilding and replacing trtllm backend #99

Merged
merged 6 commits into from
Feb 8, 2025

Conversation

tanmayv25
Copy link
Contributor

What does the PR do?

These changes adds support to rebuild and replace the TRTLLM backend bits with the source held in specified TENSORRTLLM_BACKEND_REPO_TAG.

It can be used like below:

./container/build.sh --framework tensorrtllm --tensorrtllm-backend-rebuild 1 --tensorrtllm-backend-repo-tag tanmayv-v0.16.0

Checklist

  • PR title reflects the change and is of format <commit_type>: <Title>
  • Changes are described in the pull request.
  • Related issues are referenced.
  • Populated github labels field
  • Added test plan and verified test passes.
  • Verified that the PR passes existing CI.
  • Verified copyright is correct on all changed files.
  • Added succinct git squash message before merging ref.
  • All template sections are filled out.
  • Optional: Additional screenshots for behavior/output changes with before/after.

Commit Type:

Check the conventional commit type
box here and add the label to the github PR.

  • build
  • ci
  • docs
  • feat
  • fix
  • perf
  • refactor
  • revert
  • style
  • test

@tanmayv25 tanmayv25 merged commit d917734 into main Feb 8, 2025
5 checks passed
@tanmayv25 tanmayv25 deleted the tanmayv-rebuild branch February 8, 2025 00:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants