You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I noticed that only a subset of the text generation parameters are supported by TGI.
For example num_beams and others from this list are not supported.
Is there a reason for not supporting more parameters? If not then would you be able to add them? ATM I'm interested in num_beams but later there could be more.
Thank you
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
I noticed that only a subset of the text generation parameters are supported by TGI.
For example
num_beamsand others from this list are not supported.Is there a reason for not supporting more parameters? If not then would you be able to add them? ATM I'm interested in
num_beamsbut later there could be more.Thank you
Beta Was this translation helpful? Give feedback.
All reactions