Code

Spike skipper#58

Code

Merged

saforem2 merged 8 commits intomicrosoft-mainargonne-lcf/Megatron-DeepSpeed:microsoft-mainfrom spike-skipperargonne-lcf/Megatron-DeepSpeed:spike-skipperCopy head branch name to clipboardOct 8, 2024

+412-180

Commits

Commits on Sep 15, 2024

• Update pretrain_gpt_alcf.py

  saforem2

  committed
  7cb9c11

  Copy full SHA for 7cb9c11

• Update megatron/training_log.py

  saforem2

  committed
  e83de19

  Copy full SHA for e83de19

• Warn if mismatch b/w iters in megatron/checkpointing.py

  saforem2

  committed
  29756d6

  Copy full SHA for 29756d6

Commits on Sep 16, 2024

• fix: try/except for non tensors in megatron/training_log.py

  saforem2

  committed
  1a7f03b

  Copy full SHA for 1a7f03b

Commits on Sep 17, 2024

• fix: Correctly draw grad_acc_steps batches of data when skipping step

  saforem2

  committed
  828f6a9

  Copy full SHA for 828f6a9

• Update pretrain_gpt_alcf.py

  Show description for 295fcb3
  saforem2

  committed
  295fcb3

  Copy full SHA for 295fcb3

Commits on Sep 23, 2024

• added sophia

  

  Marieme Ngom

  committed
  cf80e6b

  Copy full SHA for cf80e6b

Commits on Sep 30, 2024

• Merge pull request #59 from mngom2/spike-skipper

  Show description for 09accde
  saforem2

  authored
  09accde

  Copy full SHA for 09accde