Can we use deepspeed along with the tensorRT? #4679
debasishaimonk
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Lately i have been working on project, which has deepspeed already implemented for the transformer architecture. it gives a speed up of nearly 2x. inorder to speed up further, i was thinking of integrating tensorRT along with it. Is it possible to have both?
Beta Was this translation helpful? Give feedback.
All reactions