Skip to content

Commit

Permalink
download more
Browse files Browse the repository at this point in the history
  • Loading branch information
vbarda committed Sep 27, 2024
1 parent 58dd17b commit 41b319e
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/_scripts/download_tiktoken.py
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
import tiktoken

# This will trigger the download and caching of the necessary files
for encoding in ("gpt2", "cl100k_base"):
for encoding in ("gpt2", "gpt-3.5"):
tiktoken.encoding_for_model(encoding)

0 comments on commit 41b319e

Please sign in to comment.