Code

gpu assignment scaling#46

Code

Merged

Waino merged 9 commits intomainHelsinki-NLP/mammoth:mainfrom feat/gpu_assignment_scalingHelsinki-NLP/mammoth:feat/gpu_assignment_scalingCopy head branch name to clipboardMar 11, 2024

+287-18

Commits

Commits on Mar 4, 2024

• Script to generate dummy configs for benchmarking gpu assignment

  Waino

  committed
  8b96730

  Copy full SHA for 8b96730

• TQDM for progress tracking and jsonl output of stats

  Waino

  committed
  34e716c

  Copy full SHA for 34e716c

• extra_empty_penalty for each empty GPU

  Show description for ef2f4e3
  Waino

  committed
  ef2f4e3

  Copy full SHA for ef2f4e3

• Better initialization

  Show description for 46ffee4
  Waino

  committed
  46ffee4

  Copy full SHA for 46ffee4

• Interleave subsets consisting of least favorite tasks

  Show description for 6f17807
  Waino

  committed
  6f17807

  Copy full SHA for 6f17807

• Remove innermost tqdm

  Show description for 51128a6
  Waino

  committed
  51128a6

  Copy full SHA for 51128a6

• Parameter --time_budget_s to end gpu assignment early

  Waino

  committed
  bdb192e

  Copy full SHA for bdb192e

• Only delete node_gpu if it is set

  Waino

  committed
  e208b5c

  Copy full SHA for e208b5c

• pep8

  Waino

  committed
  735b096

  Copy full SHA for 735b096