Skip to content

Commit

Permalink
Consolidate the 1B config
Browse files Browse the repository at this point in the history
  • Loading branch information
@dirkgr
dirkgr committed Nov 3, 2024
1 parent a1271eb commit cb9c22a
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion configs/peteish1-weka.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -84,7 +84,7 @@ save_num_unsharded_checkpoints_to_keep: -1
load_path: null

max_duration: 1ep
global_train_batch_size: 1024
global_train_batch_size: 512
device_train_microbatch_size: 4

precision: amp_bf16
Expand Down

0 comments on commit cb9c22a

Please sign in to comment.