Skip to content

Commit

Permalink
Small fix
Browse files Browse the repository at this point in the history
  • Loading branch information
vblagoje committed Feb 8, 2024
1 parent 1b2faaa commit 57d7d5f
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -112,7 +112,7 @@ def __init__(
# It is hard to determine which tokenizer to use for the SageMaker model
# so we use GPT2 tokenizer which will likely provide good token count approximation
self.prompt_handler = DefaultPromptHandler(
model="gpt2",
tokenizer="gpt2",
model_max_length=model_max_length,
max_length=self.max_length or 100,
)
Expand Down

0 comments on commit 57d7d5f

Please sign in to comment.