-
|
Is there a way to change the max tokens? I'm using qwq-32b-preview and since it has really long outputs having to tell it to countinue is really annoying (model: qwen/qwq-32b-preview. Provider - Hugging Face |
Beta Was this translation helpful? Give feedback.
Answered by
Taewan-P
Dec 3, 2024
Replies: 1 comment
-
|
Not at the moment... not implemented. Try modifying the system prompt to get shorter answers that would work. |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
Capyyyyy
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Not at the moment... not implemented. Try modifying the system prompt to get shorter answers that would work.