Default model precision in TGI #1209
Closed
jerin-scalers-ai
started this conversation in
General
Replies: 1 comment
-
|
|
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
What is the default model precision (torch dtype) of model loaded into TGI server?
Beta Was this translation helpful? Give feedback.
All reactions