Code

Add gradient accumulation scheduler#21

Code

Merged

MenuaB merged 22 commits intomainYerevaNN/ChemLactica:mainfrom add_gradient_accumulation_schedulerYerevaNN/ChemLactica:add_gradient_accumulation_schedulerCopy head branch name to clipboardApr 18, 2024

+1,182-608

Commits

Commits on Mar 29, 2024

• add dynamic gradient accumulation callback

  MenuaB

  committed
  112c07c

  Copy full SHA for 112c07c

• add dynamic gradient accumulation callback

  MenuaB

  committed
  87e82d7

  Copy full SHA for 87e82d7

Commits on Apr 1, 2024

• add dynamic gradient accumulation callback

  MenuaB

  committed
  e5ae159

  Copy full SHA for e5ae159

• update environment requirements

  MenuaB

  committed
  7782b1f

  Copy full SHA for 7782b1f

• minor dynamic changes for gemma run

  MenuaB

  committed
  0e524a0

  Copy full SHA for 0e524a0

Commits on Apr 3, 2024

• Merge branch 'main' into add_gradient_accumulation_scheduler

  MenuaB

  committed
  677b052

  Copy full SHA for 677b052

• minor changes prepare for run

  MenuaB

  committed
  a1ff599

  Copy full SHA for a1ff599

Commits on Apr 4, 2024

• add grad accumulation tracking in aim

  MenuaB

  committed
  214f551

  Copy full SHA for 214f551

Commits on Apr 5, 2024

• minor changes for new run

  MenuaB

  committed
  3a2bb59

  Copy full SHA for 3a2bb59

Commits on Apr 10, 2024

• minor changes

  MenuaB

  committed
  b5d5baa

  Copy full SHA for b5d5baa

Commits on Apr 16, 2024

• add dataset playground notebook

  MenuaB

  committed
  7f5f38d

  Copy full SHA for 7f5f38d

• update model configs

  MenuaB

  committed
  2a679b6

  Copy full SHA for 2a679b6

• add grad acc configs, move grad acc to step begin

  MenuaB

  committed
  5e31dde

  Copy full SHA for 5e31dde

• back to defaults

  MenuaB

  committed
  90e8f5d

  Copy full SHA for 90e8f5d

• back to defaults

  MenuaB

  committed
  b74c0d1

  Copy full SHA for b74c0d1

• update conda env file

  MenuaB

  committed
  22e852e

  Copy full SHA for 22e852e

• minor changes

  MenuaB

  committed
  d49c562

  Copy full SHA for d49c562

• minor changes

  MenuaB

  committed
  8c1b7fe

  Copy full SHA for 8c1b7fe

• minor changes

  MenuaB

  committed
  860e50c

  Copy full SHA for 860e50c

• add test status

  MenuaB

  committed
  ee31a60

  Copy full SHA for ee31a60

Commits on Apr 18, 2024

• fix dynamic grad acc bug, fix PR issues

  MenuaB

  committed
  658125d

  Copy full SHA for 658125d

• add test status

  MenuaB

  committed
  6ad0bc1

  Copy full SHA for 6ad0bc1