Code

DaCe VRAM pooling#295

Code

Merged

FlorianDeconinck merged 134 commits intomainai2cm/pace:mainfrom dace_transient_pooledai2cm/pace:dace_transient_pooledCopy head branch name to clipboardAug 29, 2022

+294-81

Commits

Commits on Jun 14, 2022

• Allow for env var to control orchestration

  FlorianDeconinck

  committed
  df4c245

  Copy full SHA for df4c245

• (some) Translate tests

  FlorianDeconinck

  committed
  afd41a0

  Copy full SHA for afd41a0

• Failing flllz orchestration

  FlorianDeconinck

  committed
  03a3ba4

  Copy full SHA for 03a3ba4

Commits on Jun 15, 2022

• (Re)Orchestrate remapping

  FlorianDeconinck

  committed
  b9f9146

  Copy full SHA for b9f9146

Commits on Jun 16, 2022

• Fix orchestrate for new DaCe

  Show description for 1b79998
  FlorianDeconinck

  committed
  1b79998

  Copy full SHA for 1b79998

• Removing extra guard irrelevant since load_once is gone

  FlorianDeconinck

  committed
  9250283

  Copy full SHA for 9250283

• Correct type hint & return

  FlorianDeconinck

  committed
  a4939d7

  Copy full SHA for a4939d7

Commits on Jun 17, 2022

• Use lazy_stencil when orchestrating

  Show description for c0e326c
  FlorianDeconinck

  committed
  c0e326c

  Copy full SHA for c0e326c

• Making sure lazy_stencil doesn't trigger before __call__

  FlorianDeconinck

  committed
  65f3164

  Copy full SHA for 65f3164

• Remove the need to cache Communicator in dace_config

  Show description for 97eac2d
  FlorianDeconinck

  committed
  97eac2d

  Copy full SHA for 97eac2d

• Fixing communicator removed from DaceConfig

  FlorianDeconinck

  committed
  2680451

  Copy full SHA for 2680451

• Merge branch 'DaceConfig_RemoveComm' into reorchestrate_all_modules

  FlorianDeconinck

  committed
  257cb06

  Copy full SHA for 257cb06

Commits on Jun 20, 2022

• Integrate LazyStencil.field_info fix

  Show description for ac1aec5
  FlorianDeconinck

  committed
  ac1aec5

  Copy full SHA for ac1aec5

• Remove unused _frozen_stencil() in stencil

  FlorianDeconinck

  committed
  4394d99

  Copy full SHA for 4394d99

• Add domain to stencil __sdfg__

  FlorianDeconinck

  committed
  01b40e3

  Copy full SHA for 01b40e3

Commits on Jun 21, 2022

• Orchestrate tracers

  Show description for 43eca42
  FlorianDeconinck

  committed
  43eca42

  Copy full SHA for 43eca42

• Orchestrate: microphysics (minus driver)

  FlorianDeconinck

  committed
  c119b93

  Copy full SHA for c119b93

Commits on Jun 22, 2022

• Merge branch 'orchestrate_on_AOT_stencils' into reorchestrate_all_modules

  FlorianDeconinck

  committed
  9d06b5f

  Copy full SHA for 9d06b5f

• Change orchestration build pipe to more efficient trf passes

  Show description for 31934be
  FlorianDeconinck

  committed
  31934be

  Copy full SHA for 31934be

• Minor

  FlorianDeconinck

  committed
  faf18c0

  Copy full SHA for faf18c0

• Orchestrate: fv_dynamics

  FlorianDeconinck

  committed
  7d1f3d2

  Copy full SHA for 7d1f3d2

• Minor

  FlorianDeconinck

  committed
  4f721d1

  Copy full SHA for 4f721d1

Commits on Jun 23, 2022

• Updating dace.conf

  Show description for 7882901
  FlorianDeconinck

  committed
  7882901

  Copy full SHA for 7882901

• gitignore; DaCe & test

  FlorianDeconinck

  committed
  4e582f0

  Copy full SHA for 4e582f0

• Verbose

  FlorianDeconinck

  committed
  53e8f03

  Copy full SHA for 53e8f03

• Boolean logic be hard

  FlorianDeconinck

  committed
  15f6d8e

  Copy full SHA for 15f6d8e

• Removing dace.conf and replacing it with direct call to conf API

  FlorianDeconinck

  committed
  25e5bac

  Copy full SHA for 25e5bac

• Restrict dace.config setup to orchestration

  FlorianDeconinck

  committed
  da6e9d2

  Copy full SHA for da6e9d2

• Orchestration: FV_Dynamics

  FlorianDeconinck

  committed
  2798f8f

  Copy full SHA for 2798f8f

Commits on Jun 27, 2022

• Move parsing in orchestration to commong fn, time.

  FlorianDeconinck

  committed
  72e9ae2

  Copy full SHA for 72e9ae2

• Use_cache on SDFG gen & verbose print

  FlorianDeconinck

  committed
  7fd16aa

  Copy full SHA for 7fd16aa

• Orchestration: driver

  Show description for d3d4f32
  FlorianDeconinck

  committed
  d3d4f32

  Copy full SHA for d3d4f32

• Driver example: c12 baroclinic orchestration on CPU

  FlorianDeconinck

  committed
  eabd66b

  Copy full SHA for eabd66b

• Merge remote-tracking branch 'origin/main' into reorchestrate_all_modules

  FlorianDeconinck

  committed
  7bc7978

  Copy full SHA for 7bc7978

• Linting

  FlorianDeconinck

  committed
  76d5771

  Copy full SHA for 76d5771

• More linting

  FlorianDeconinck

  committed
  d0199a7

  Copy full SHA for d0199a7

• Revert cache us on sdfg parse

  Show description for cc28498
  FlorianDeconinck

  committed
  cc28498

  Copy full SHA for cc28498

Commits on Jun 28, 2022

• Fix timestep computation. Move in Config

  Show description for 429f495
  FlorianDeconinck

  committed
  429f495

  Copy full SHA for 429f495

Commits on Jun 29, 2022

• Modify Physics call structure to allow for DaCe parsing limit

  Show description for 929ce00
  FlorianDeconinck

  committed
  929ce00

  Copy full SHA for 929ce00

• Fix rank read in build.py logging

  FlorianDeconinck

  committed
  6364776

  Copy full SHA for 6364776

• Fix log_on_rank_0 on MPI

  FlorianDeconinck

  committed
  2ed46da

  Copy full SHA for 2ed46da

• Bypass parsing when not the rank that should be compiling

  FlorianDeconinck

  committed
  b8c0f8c

  Copy full SHA for b8c0f8c

Commits on Jun 30, 2022

• Linting

  FlorianDeconinck

  committed
  8f3d4e8

  Copy full SHA for 8f3d4e8

• Fix test_fv3core

  FlorianDeconinck

  committed
  252f371

  Copy full SHA for 252f371

• Rename module orchestrate to orchestration

  FlorianDeconinck

  committed
  fc03f2b

  Copy full SHA for fc03f2b

• Swap .layout/decomposition for a post-build write up & runtime check

  FlorianDeconinck

  committed
  1cd473d

  Copy full SHA for 1cd473d

• Fix dace_config save in restart

  FlorianDeconinck

  committed
  3758d44

  Copy full SHA for 3758d44

• Lint

  FlorianDeconinck

  committed
  8bf16d9

  Copy full SHA for 8bf16d9

• Merge branch 'main' into reorchestrate_all_modules

  FlorianDeconinck

  committed
  80fb2a8

  Copy full SHA for 80fb2a8

• Typo

  FlorianDeconinck

  committed
  707935e

  Copy full SHA for 707935e

• lint

  FlorianDeconinck

  committed
  838a18d

  Copy full SHA for 838a18d

• Fix dace_config serialization for Restart

  FlorianDeconinck

  committed
  cda9cda

  Copy full SHA for cda9cda

• dace_config is optional

  FlorianDeconinck

  committed
  fc6b30a

  Copy full SHA for fc6b30a

• lint

  FlorianDeconinck

  committed
  ef13fda

  Copy full SHA for ef13fda

• Update dace version

  FlorianDeconinck

  committed
  2e9b2ef

  Copy full SHA for 2e9b2ef

• Update constraints.txt

  FlorianDeconinck

  committed
  b0d3ecd

  Copy full SHA for b0d3ecd

Commits on Jul 5, 2022

• Guard against degenerate behavior for FV3_DACEMODE

  FlorianDeconinck

  committed
  52b1165

  Copy full SHA for 52b1165

• Merge remote-tracking branch 'origin/reorchestrate_all_modules' into reorchestrate_all_modules

  FlorianDeconinck

  committed
  1f551c6

  Copy full SHA for 1f551c6

Commits on Jul 7, 2022

• PR notes - verbosing behavior

  FlorianDeconinck

  committed
  8a06268

  Copy full SHA for 8a06268

Commits on Jul 8, 2022

• Driver performance critical function renamed & verbosed

  FlorianDeconinck

  committed
  f0c7591

  Copy full SHA for f0c7591

• Merge branch 'main' into reorchestrate_all_modules

  FlorianDeconinck

  committed
  ff10723

  Copy full SHA for ff10723

• Extend write/verification of the build_info

  FlorianDeconinck

  committed
  49a55e1

  Copy full SHA for 49a55e1

• Missing serialization field

  FlorianDeconinck

  committed
  797f11d

  Copy full SHA for 797f11d

Commits on Jul 12, 2022

• Fix build_info file

  FlorianDeconinck

  committed
  0b6aa3f

  Copy full SHA for 0b6aa3f

• Small fix

  FlorianDeconinck

  committed
  2b8d503

  Copy full SHA for 2b8d503

• Small fix

  FlorianDeconinck

  committed
  737003a

  Copy full SHA for 737003a

• SDFG count RAM/VRAM

  Show description for 35e5e1c
  FlorianDeconinck

  committed
  35e5e1c

  Copy full SHA for 35e5e1c

Commits on Jul 13, 2022

• Fix cmd line

  FlorianDeconinck

  committed
  3a662f1

  Copy full SHA for 3a662f1

• Update Pace code to DaCe v0.14 RC (TBR)

  Show description for 854d819
  FlorianDeconinck

  committed
  854d819

  Copy full SHA for 854d819

• Update DaCe to 0.14rc1

  FlorianDeconinck

  committed
  2e96bf9

  Copy full SHA for 2e96bf9

• Fix SDFG load on distributed cache

  FlorianDeconinck

  committed
  5dc3eae

  Copy full SHA for 5dc3eae

• Microphysics: move setup computation on proper device

  FlorianDeconinck

  committed
  0ac1090

  Copy full SHA for 0ac1090

• update gt4py to branch

  

  tobias

  committed
  24b36ff

  Copy full SHA for 24b36ff

Commits on Jul 14, 2022

• Merge branch 'reorchestrate_all_modules' into dace_auto_RAM_read

  FlorianDeconinck

  committed
  b3a366d

  Copy full SHA for b3a366d

• Add per file and in-memory options

  FlorianDeconinck

  committed
  b11cb1a

  Copy full SHA for b11cb1a

• Re-insert performance collection after each timestep

  Show description for 8ee1ed7
  FlorianDeconinck

  committed
  8ee1ed7

  Copy full SHA for 8ee1ed7

Commits on Jul 15, 2022

• Fix microphysics setup computation on proper Host/Device

  FlorianDeconinck

  committed
  3f1684a

  Copy full SHA for 3f1684a

• lint

  FlorianDeconinck

  committed
  608fa90

  Copy full SHA for 608fa90

• Fix to the ContextLib orchestration

  FlorianDeconinck

  committed
  4c57da9

  Copy full SHA for 4c57da9

• Merge branch 'main' into reorchestrate_all_modules

  FlorianDeconinck

  committed
  3ef571a

  Copy full SHA for 3ef571a

• Merge branch 'reorchestrate_all_modules' into dace_auto_RAM_read

  FlorianDeconinck

  committed
  234368e

  Copy full SHA for 234368e

Commits on Jul 16, 2022

• Detail reporting

  FlorianDeconinck

  committed
  2e0f449

  Copy full SHA for 2e0f449

Commits on Jul 20, 2022

• Fix command line

  FlorianDeconinck

  committed
  2ebe9e8

  Copy full SHA for 2ebe9e8

Commits on Jul 22, 2022

• Do not instantiate Physics if you are not going to run it

  Show description for e4281b5
  FlorianDeconinck

  committed
  e4281b5

  Copy full SHA for e4281b5

• Add debug tools

  FlorianDeconinck

  committed
  06ab595

  Copy full SHA for 06ab595

Commits on Jul 24, 2022

• Drivre: Fix timestep, fix end_of_step_actions for orchestration

  Show description for 29fe391
  FlorianDeconinck

  committed
  29fe391

  Copy full SHA for 29fe391

• DaCe orchestrated: proper blocking size, comiple for newer target SM

  FlorianDeconinck

  committed
  daeb8d4

  Copy full SHA for daeb8d4

• Merge branch 'main' into stable_orchestration

  FlorianDeconinck

  committed
  7078866

  Copy full SHA for 7078866

• Lint

  FlorianDeconinck

  committed
  d7dd1b8

  Copy full SHA for d7dd1b8

• Tweaking report to display orchestrated

  FlorianDeconinck

  committed
  1e12120

  Copy full SHA for 1e12120

• Merge branch 'stable_orchestration' into dace_auto_RAM_read

  FlorianDeconinck

  committed
  b1914f7

  Copy full SHA for b1914f7

Commits on Jul 25, 2022

• LINT

  FlorianDeconinck

  committed
  fee465f

  Copy full SHA for fee465f

• Added static analysis to end of build

  FlorianDeconinck

  committed
  915e19e

  Copy full SHA for 915e19e

• Verbose

  FlorianDeconinck

  committed
  04f9458

  Copy full SHA for 04f9458

• NaN Check: removing unused code, auto schedule type, verbose

  FlorianDeconinck

  committed
  ea3e311

  Copy full SHA for ea3e311

Commits on Jul 26, 2022

• Pass down transient flag

  Show description for 29bd9d3
  FlorianDeconinck

  committed
  29bd9d3

  Copy full SHA for 29bd9d3

• Merge branch 'main' into stable_orchestration

  FlorianDeconinck

  committed
  4b988e7

  Copy full SHA for 4b988e7

• Update dace to v0.14rc2

  FlorianDeconinck

  committed
  57c1037

  Copy full SHA for 57c1037

• Make constraints.txt happy

  FlorianDeconinck

  committed
  0cbff4c

  Copy full SHA for 0cbff4c

• Remove dace constraints -> per PIP requirements workaround

  FlorianDeconinck

  committed
  5e2a35f

  Copy full SHA for 5e2a35f

• Merge branch 'stable_orchestration' into dace_transient_pooled

  FlorianDeconinck

  committed
  310c45e

  Copy full SHA for 310c45e

Commits on Jul 27, 2022

• Orchestration: pool persistent mem

  Show description for 7d75ace
  FlorianDeconinck

  committed
  7d75ace

  Copy full SHA for 7d75ace

• Merge branch 'dace_auto_RAM_read' into dace_transient_pooled

  FlorianDeconinck

  committed
  b98c64b

  Copy full SHA for b98c64b

• Remove -e from constraints.txt per PIP

  FlorianDeconinck

  committed
  4a087a3

  Copy full SHA for 4a087a3

Commits on Jul 28, 2022

• Dace config: query dace syncdebug

  Show description for 1467a41
  FlorianDeconinck

  committed
  1467a41

  Copy full SHA for 1467a41

Commits on Aug 1, 2022

• Merge branch 'main' into stable_orchestration

  FlorianDeconinck

  committed
  a7b3393

  Copy full SHA for a7b3393

• Move gt4py & own reference to DaCe to rc2 capable

  FlorianDeconinck

  committed
  401906c

  Copy full SHA for 401906c

• GT4Py dace versionning relaxed constraints

  FlorianDeconinck

  committed
  4bde297

  Copy full SHA for 4bde297

• Add Dace requirements to the driver

  FlorianDeconinck

  committed
  70f1032

  Copy full SHA for 70f1032

Commits on Aug 8, 2022

• Make daint pre-install dace to go around new PIP behavior of refusing git+ in constraints files

  FlorianDeconinck

  committed
  4283e5a

  Copy full SHA for 4283e5a

• Move dace install up (?) on daint

  FlorianDeconinck

  committed
  46b1d85

  Copy full SHA for 46b1d85

Commits on Aug 9, 2022

• Copy changes to the other (sic) install_virtualenv, for more env fun

  FlorianDeconinck

  committed
  fc10613

  Copy full SHA for fc10613

• typo

  FlorianDeconinck

  committed
  299f327

  Copy full SHA for 299f327

Commits on Aug 18, 2022

• Merge branch 'stable_orchestration' into dace_transient_pooled

  FlorianDeconinck

  committed
  ffeacb0

  Copy full SHA for ffeacb0

• Merge remote-tracking branch 'origin/main' into stable_orchestration

  FlorianDeconinck

  committed
  5ecf71a

  Copy full SHA for 5ecf71a

Commits on Aug 19, 2022

• DaCe config: remoce check_args (not needed & unsupported in new DaCe)

  FlorianDeconinck

  committed
  64b9dec

  Copy full SHA for 64b9dec

• Merge branch 'stable_orchestration' into dace_transient_pooled

  FlorianDeconinck

  committed
  c05127a

  Copy full SHA for c05127a

• Lint

  FlorianDeconinck

  committed
  772bf71

  Copy full SHA for 772bf71

Commits on Aug 23, 2022

• Merge branch 'main' into dace_transient_pooled

  FlorianDeconinck

  committed
  cc19793

  Copy full SHA for cc19793

• Fix merge errors

  FlorianDeconinck

  committed
  ce0dfed

  Copy full SHA for ce0dfed

• Remove orch .yaml example

  Show description for b0e62c3
  FlorianDeconinck

  committed
  b0e62c3

  Copy full SHA for b0e62c3

• Use logger instead print

  FlorianDeconinck

  committed
  3b3713d

  Copy full SHA for 3b3713d

• Lint

  FlorianDeconinck

  committed
  ba15084

  Copy full SHA for ba15084

• Merge remote-tracking branch 'origin/HEAD' into dace_transient_pooled

  FlorianDeconinck

  committed
  bb6cadb

  Copy full SHA for bb6cadb

Commits on Aug 24, 2022

• Fix logging

  FlorianDeconinck

  committed
  836a064

  Copy full SHA for 836a064

• Merge remote-tracking branch 'origin/main' into dace_transient_pooled

  FlorianDeconinck

  committed
  41f8a92

  Copy full SHA for 41f8a92

• Merge remote-tracking branch 'origin/main' into dace_transient_pooled

  FlorianDeconinck

  committed
  4642f85

  Copy full SHA for 4642f85

• Deactivate distributed compile

  FlorianDeconinck

  committed
  b8398e9

  Copy full SHA for b8398e9

• Move flag to dace_config

  FlorianDeconinck

  committed
  f8c0d9d

  Copy full SHA for f8c0d9d

Commits on Aug 26, 2022

• dace >= 0.14 for VRAM pooling

  FlorianDeconinck

  committed
  8287dbc

  Copy full SHA for 8287dbc

• Remove -e from constraint.txt + lint

  FlorianDeconinck

  committed
  f27e449

  Copy full SHA for f27e449

• Make CUDA timer safe for non-CUDA context

  FlorianDeconinck

  committed
  fe29275

  Copy full SHA for fe29275

• Reuse GPU availability code & optional import

  FlorianDeconinck

  committed
  761ade2

  Copy full SHA for 761ade2

Commits on Aug 29, 2022

• Cleanup & PR notes

  FlorianDeconinck

  committed
  5d18530

  Copy full SHA for 5d18530