Skip to content

Commit

Permalink
Another small bugfix.
Browse files Browse the repository at this point in the history
  • Loading branch information
GeorgiosSmyrnis committed May 13, 2024
1 parent feee5b6 commit 9d9708c
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion open_lm/main.py
Original file line number Diff line number Diff line change
Expand Up @@ -835,7 +835,7 @@ def main(args):

if num_ckpt_too_few_tokens > args.data_tolerate_num_ckpts:
raise RuntimeError(
f"{num_ckpt_too_few_tokens} checkpoints happened where the number of tokens seen was less than {args.expected_tokens} of expected. This is likely due to transient errors e.g. reading from S3."
f"{num_ckpt_too_few_tokens} checkpoints happened where the number of tokens seen was less than {1 - args.data_tolerate_error_p} of expected. This is likely due to transient errors e.g. reading from S3."
)

epoch = epoch + 1
Expand Down

0 comments on commit 9d9708c

Please sign in to comment.