Skip to content

Commit

Permalink
fix o1 API call: ignore avoid_repetition and response_format_type opt…
Browse files Browse the repository at this point in the history
…ions

both are not supported by the o1 API at this point
  • Loading branch information
nikochiko committed Jan 13, 2025
1 parent 51cd0ed commit 89a49c3
Showing 1 changed file with 4 additions and 0 deletions.
4 changes: 4 additions & 0 deletions daras_ai_v2/language_model.py
Original file line number Diff line number Diff line change
Expand Up @@ -1049,7 +1049,11 @@ def run_openai_chat(
for entry in messages:
if entry["role"] == CHATML_ROLE_SYSTEM:
entry["role"] = CHATML_ROLE_USER

# unsupported API options
max_tokens = NOT_GIVEN
response_format_type = None
avoid_repetition = False

# reserved tokens for reasoning...
# https://platform.openai.com/docs/guides/reasoning#allocating-space-for-reasoning
Expand Down

0 comments on commit 89a49c3

Please sign in to comment.