Code

Legal Whammy for 7B#750

Code

Merged

dirkgr merged 34 commits intomainallenai/OLMo:mainfrom dave/annealing_peteish_v2allenai/OLMo:dave/annealing_peteish_v2Copy head branch name to clipboardNov 26, 2024

Commits

Commits on Oct 31, 2024

• nvidia cls

  soldni

  committed
  7e3e560

  Copy full SHA for 7e3e560

• seed

  soldni

  committed
  11bf497

  Copy full SHA for 11bf497

• changed seed runs

  soldni

  committed
  e843332

  Copy full SHA for e843332

• wrong name

  soldni

  committed
  c87d253

  Copy full SHA for c87d253

Commits on Nov 1, 2024

• forgot to set seed

  soldni

  committed
  1fe8930

  Copy full SHA for 1fe8930

• added megamath config

  

  Matt Jordan

  committed
  b9dccb8

  Copy full SHA for b9dccb8

• Added config maker script

  

  Matt Jordan

  committed
  b636430

  Copy full SHA for b636430

Commits on Nov 2, 2024

• Fixed configs, we hope

  

  Matt Jordan

  committed
  8d65dfc

  Copy full SHA for 8d65dfc

• Okay actually hopefully working

  

  Matt Jordan

  committed
  9b0779e

  Copy full SHA for 9b0779e

• Fixed some dumb syntax errors in config maker--oops

  

  Matt Jordan

  committed
  d11bd99

  Copy full SHA for d11bd99

Commits on Nov 4, 2024

• more seeds

  soldni

  committed
  f7a1535

  Copy full SHA for f7a1535

Commits on Nov 5, 2024

• megamath + other good data mix config

  

  Matt Jordan

  committed
  b5fc795

  Copy full SHA for b5fc795

• Merge branch 'dave/annealing_peteish_v2' of github.com:allenai/OLMo into dave/annealing_peteish_v2

  

  Matt Jordan

  committed
  6f50a54

  Copy full SHA for 6f50a54

Commits on Nov 7, 2024

• Microannealing configs

  

  Matt Jordan

  committed
  eac01ed

  Copy full SHA for eac01ed

Commits on Nov 8, 2024

• Added pes2o, se, tinyGSM_inline

  

  Matt Jordan

  committed
  d84c561

  Copy full SHA for d84c561

Commits on Nov 9, 2024

• Added bestof-v1 and small-sources-multiadd

  

  Matt Jordan

  committed
  62f23d0

  Copy full SHA for 62f23d0

Commits on Nov 11, 2024

• no whammy config

  

  Matt Jordan

  committed
  a7a8fb4

  Copy full SHA for a7a8fb4

Commits on Nov 12, 2024

• Better basic-math-mj-multiadd

  

  Matt Jordan

  committed
  4a1149b

  Copy full SHA for 4a1149b

• Added small-sources-big-dclm microanneal

  

  Matt Jordan

  committed
  11ff008

  Copy full SHA for 11ff008

• Added shadow clone configs

  

  Matt Jordan

  committed
  e0705bc

  Copy full SHA for e0705bc

Commits on Nov 13, 2024

• No-whammy3 + Reddit-v1 micro

  

  Matt Jordan

  committed
  16383fe

  Copy full SHA for 16383fe

• Fixed reddit data?

  

  Matt Jordan

  committed
  95c395f

  Copy full SHA for 95c395f

Commits on Nov 14, 2024

• Actual seed 42

  

  Matt Jordan

  committed
  21dc750

  Copy full SHA for 21dc750

• No-whammy-2 soup ingredients

  

  Matt Jordan

  committed
  089eecb

  Copy full SHA for 089eecb

Commits on Nov 15, 2024

• Added reddit-qa-all

  

  Matt Jordan

  committed
  490170c

  Copy full SHA for 490170c

Commits on Nov 16, 2024

• No-whammy-2 100B

  

  Matt Jordan

  committed
  6f2eb00

  Copy full SHA for 6f2eb00

Commits on Nov 19, 2024

• Added legalwhammy2 configs (7B only)

  

  Matt Jordan

  committed
  8849fd4

  Copy full SHA for 8849fd4

• Fixed 300B legalWhammy

  

  Matt Jordan

  committed
  168ece1

  Copy full SHA for 168ece1

• Legal Whammy forreal this time

  

  Matt Jordan

  committed
  06d1e9a

  Copy full SHA for 06d1e9a

Commits on Nov 26, 2024

• Merge remote-tracking branch 'origin/main' into dave/annealing_peteish_v2

  dirkgr

  committed
  d7623fb

  Copy full SHA for d7623fb

• Formatting

  dirkgr

  committed
  e892ce5

  Copy full SHA for e892ce5

• Make lint happy

  dirkgr

  committed
  a2fa5d5

  Copy full SHA for a2fa5d5

• mypy

  dirkgr

  committed
  3f870df

  Copy full SHA for 3f870df

• isort

  dirkgr

  committed
  ba286ad

  Copy full SHA for ba286ad