You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Add a parameter for thinking effort to the generation settings like it's done here:
https://github.com/and270/thinking_effort_processor
I assume that it uses top-k, if the token appears high enough based on the parameter (like 0.2) it will be written. But better read the given repository, to see how it is done.
The text was updated successfully, but these errors were encountered:
I assume that it uses top-k, if the token appears high enough based on the parameter (like 0.2) it will be written. But better read the given repository, to see how it is done.
The text was updated successfully, but these errors were encountered: