Skip to content

Commit

Permalink
Even less frequently
Browse files Browse the repository at this point in the history
  • Loading branch information
dirkgr committed Nov 5, 2024
1 parent 9b1c670 commit f33abac
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions scripts/augusta/beaker/peteish1.sh
Original file line number Diff line number Diff line change
Expand Up @@ -66,8 +66,8 @@ torchrun \
configs/peteish1-google.yaml \
--run_name=$RUN_NAME \
--wandb.group=$NAME \
--save_interval_ephemeral=5000 \
--eval_interval=5000 \
--save_interval_ephemeral=10000 \
--eval_interval=10000 \
--fsdp.sharding_strategy=_HYBRID_SHARD_ZERO2 \
--fsdp.hybrid_sharding_num_model_replicas="${BEAKER_REPLICA_COUNT}" \
--fsdp.wrapping_strategy=by_block_and_size \
Expand Down

0 comments on commit f33abac

Please sign in to comment.