Code

Schema based configuration#105

Code

Draft

brettviren wants to merge 140 commits intoWireCell:masterWireCell/wire-cell-toolkit:masterfrom brettviren:cfgschemabrettviren/wire-cell-toolkit:cfgschemaCopy head branch name to clipboard

+80,879-14,724

Commits

Commits on Apr 26, 2021

• update with new naming

  HaiwangYu

  committed
  a328d01

  Copy full SHA for a328d01

• add json cfg

  HaiwangYu

  committed
  6006cb2

  Copy full SHA for 6006cb2

Commits on Apr 27, 2021

• use pcbro for now

  HaiwangYu

  committed
  aeab056

  Copy full SHA for aeab056

Commits on Jun 8, 2021

• response_plane as parameter

  HaiwangYu

  committed
  e7f1ecf

  Copy full SHA for e7f1ecf

• add nf-sp for VD

  HaiwangYu

  committed
  a2a271f

  Copy full SHA for a2a271f

• G4RefTime as parameter

  HaiwangYu

  committed
  8718436

  Copy full SHA for 8718436

Commits on Jun 10, 2021

• config. response_plane

  HaiwangYu

  committed
  8e4917f

  Copy full SHA for 8e4917f

• offset fix

  HaiwangYu

  committed
  26721c1

  Copy full SHA for 26721c1

• ch_per_plane and other configurations

  HaiwangYu

  committed
  6ecbfdb

  Copy full SHA for 6ecbfdb

Commits on Jun 14, 2021

• init wcls-sim-drift-simchannel.fcl

  HaiwangYu

  committed
  946b1ca

  Copy full SHA for 946b1ca

Commits on Jun 21, 2021

• Very first step of schema based configuration.

  brettviren

  committed
  d47a145

  Copy full SHA for d47a145

• Break each schema into its own pair of headers

  brettviren

  committed
  db59ef0

  Copy full SHA for db59ef0

Commits on Jun 22, 2021

• Convert TrackDepos to schema based configuration

  brettviren

  committed
  22728e1

  Copy full SHA for 22728e1

Commits on Jun 23, 2021

• fix code and string miss-use

  HaiwangYu

  committed
  8a4bab3

  Copy full SHA for 8a4bab3

• json -> jsonnet

  HaiwangYu

  committed
  a8cb14d

  Copy full SHA for a8cb14d

Commits on Jun 24, 2021

• Add generation of Jsonnet constructor functions

  brettviren

  committed
  ad6f91b

  Copy full SHA for ad6f91b

Commits on Jun 25, 2021

• Fix regressions in TrackDepos and convert Ductor and DepoSplat

  brettviren

  committed
  6909b91

  Copy full SHA for 6909b91

• Add codegen to wscript, needing a naming convention change

  Show description for ad43503
  brettviren

  committed
  ad43503

  Copy full SHA for ad43503

• Remove now undeeded manual script, update readme to match

  brettviren

  committed
  b84a807

  Copy full SHA for b84a807

Commits on Jun 30, 2021

• add fcl param

  HaiwangYu

  committed
  be06c9e

  Copy full SHA for be06c9e

• fix typo

  HaiwangYu

  committed
  834f900

  Copy full SHA for 834f900

Commits on Jul 1, 2021

• Drop C++ jsonnet and use C API

  Show description for a969fbb
  brettviren

  committed
  a969fbb

  Copy full SHA for a969fbb

Commits on Jul 7, 2021

• Merge pull request #107 from brettviren/cgojsonnet

  Show description for a04641a
  HaiwangYu

  authored
  a04641a

  Copy full SHA for a04641a

Commits on Jul 8, 2021

• merge master

  HaiwangYu

  committed
  04210fc

  Copy full SHA for 04210fc

Commits on Jul 15, 2021

• More conversion to schema

  brettviren

  committed
  8f1fe93

  Copy full SHA for 8f1fe93

Commits on Jul 16, 2021

• Fix #109.

  brettviren

  committed
  635fa23

  Copy full SHA for 635fa23

Commits on Jul 23, 2021

• Merge pull request #110 from brettviren/add-back-mt

  Show description for aa91137
  brettviren

  authored
  aa91137

  Copy full SHA for aa91137

• Fix #113 by making ImpactResponse::spectrum() thread safe.

  Show description for d577b97
  brettviren

  committed
  d577b97

  Copy full SHA for d577b97

Commits on Jul 26, 2021

• Merge pull request #114 from WireCell/fix-ii-mt-race

  Show description for baa313e
  brettviren

  authored
  baa313e

  Copy full SHA for baa313e

• Fix #115 array ordering mismatch and deal with Numpy dynamically chosing C/F order

  Show description for 9fe1184
  brettviren

  committed
  9fe1184

  Copy full SHA for 9fe1184

• Merge pull request #116 from WireCell/fix115

  Show description for e516ac9
  brettviren

  authored
  e516ac9

  Copy full SHA for e516ac9

Commits on Jul 29, 2021

• Make parent directory for output npz if it doesn't exist. Fix #117

  brettviren

  committed
  1d06dbd

  Copy full SHA for 1d06dbd

Commits on Aug 3, 2021

• Do not try to make the parent directory if it is not located

  brettviren

  committed
  34d36a4

  Copy full SHA for 34d36a4

• This test came back, it should be disabled

  brettviren

  committed
  f7a3ed1

  Copy full SHA for f7a3ed1

• Make tagging of Ductor configurable

  brettviren

  committed
  adb19ef

  Copy full SHA for adb19ef

• Break DepoSplat away from using Ductor as base to reduce confusion about what configuration actually matters

  brettviren

  committed
  2912486

  Copy full SHA for 2912486

Commits on Aug 4, 2021

• More consistent frame tagging, add fluctuation to DepoSplat

  Show description for a13a04d
  brettviren

  committed
  a13a04d

  Copy full SHA for a13a04d

Commits on Aug 10, 2021

• Add cluster file sink and clean up the nodes graph dot

  brettviren

  committed
  ddeee20

  Copy full SHA for ddeee20

• git subrepo clone [email protected]:brettviren/custard.git sio/src/custard

  Show description for 7a05eb8
  brettviren

  committed
  7a05eb8

  Copy full SHA for 7a05eb8

• Move private cluster helpers to aux, get basic sink written

  brettviren

  committed
  701b707

  Copy full SHA for 701b707

Commits on Aug 11, 2021

• Get numpy writing initially tested

  brettviren

  committed
  9dd7861

  Copy full SHA for 9dd7861

• Add start of frame file sink and make 'Aux' namespace consistently capitalized

  brettviren

  committed
  8faf80f

  Copy full SHA for 8faf80f

Commits on Aug 12, 2021

• Rename files, add make and test and more docs

  brettviren

  committed
  9d3758c

  Copy full SHA for 9d3758c

• Move nljs, custard finishes/fixes

  brettviren

  committed
  483ed78

  Copy full SHA for 483ed78

• git subrepo push sio/src/custard

  Show description for d337b9e
  brettviren

  committed
  d337b9e

  Copy full SHA for d337b9e

• Remove custard subrepo in prep to move it to better spot

  brettviren

  committed
  82784b1

  Copy full SHA for 82784b1

• git subrepo clone [email protected]:brettviren/custard.git util/inc/custard

  Show description for 1f4b162
  brettviren

  committed
  1f4b162

  Copy full SHA for 1f4b162

• Test and fix vector writing.

  brettviren

  committed
  0935c92

  Copy full SHA for 0935c92

• git subrepo push util/inc/custard

  Show description for a1190f6
  brettviren

  committed
  a1190f6

  Copy full SHA for a1190f6

• Add a 'tap' construction pattern for pgrapher

  brettviren

  committed
  5c165f5

  Copy full SHA for 5c165f5

• Check for EOS and protect against empty frames

  brettviren

  committed
  6664a02

  Copy full SHA for 6664a02

Commits on Aug 13, 2021

• Use correct file ext

  brettviren

  committed
  d264fa4

  Copy full SHA for d264fa4

• Use only unity concurrence. Fix #121.

  brettviren

  committed
  06777e0

  Copy full SHA for 06777e0

• Logging cleanup and improvements made along the way to fixing #121.

  brettviren

  committed
  666c358

  Copy full SHA for 666c358

• Pop and do not flush at EOS.

  brettviren

  committed
  b3ee9a8

  Copy full SHA for b3ee9a8

• Fix more bad logging

  brettviren

  committed
  028e9ea

  Copy full SHA for 028e9ea

• Fix ordering of filters and add tests for compression/decompress

  brettviren

  committed
  83007c9

  Copy full SHA for 83007c9

Commits on Aug 14, 2021

• Assure output directory

  brettviren

  committed
  4c75841

  Copy full SHA for 4c75841

• Make frame file sink an ITerminal so it may close the file at exit

  brettviren

  committed
  41656c8

  Copy full SHA for 41656c8

• git subrepo push util/inc/custard

  Show description for 4756db5
  brettviren

  committed
  4756db5

  Copy full SHA for 4756db5

Commits on Aug 16, 2021

• Fix typos in .npy file name pattern

  brettviren

  committed
  7952064

  Copy full SHA for 7952064

• git subrepo pull util/inc/custard

  Show description for d6c4c62
  brettviren

  committed
  d6c4c62

  Copy full SHA for d6c4c62

Commits on Aug 17, 2021

• Again move these 'private' vendored headers to a spot less likely to be accidentally made 'public'

  brettviren

  committed
  61b8f93

  Copy full SHA for 61b8f93

• git subrepo clone [email protected]:brettviren/custard.git util/src/custard

  Show description for 5e968b5
  brettviren

  committed
  5e968b5

  Copy full SHA for 5e968b5

• Add nljs directly

  brettviren

  committed
  ed66508

  Copy full SHA for ed66508

• git subrepo push util/src/custard

  Show description for 07e0e35
  brettviren

  committed
  07e0e35

  Copy full SHA for 07e0e35

• Build pedantic clean

  brettviren

  committed
  d9878f9

  Copy full SHA for d9878f9

• git subrepo push util/src/custard

  Show description for b2bdf15
  brettviren

  committed
  b2bdf15

  Copy full SHA for b2bdf15

• Again with the moving

  brettviren

  committed
  92bfc35

  Copy full SHA for 92bfc35

• git subrepo clone [email protected]:brettviren/custard.git util/inc/custard

  Show description for e873b22
  brettviren

  committed
  e873b22

  Copy full SHA for e873b22

• Integrate custard

  brettviren

  committed
  41ac979

  Copy full SHA for 41ac979

• Quiet missed cerr

  brettviren

  committed
  0245b05

  Copy full SHA for 0245b05

• git subrepo push util/inc/custard

  Show description for 458166b
  brettviren

  committed
  458166b

  Copy full SHA for 458166b

• Finish integrating custard/pigenc

  brettviren

  committed
  bd24940

  Copy full SHA for bd24940

• A test relevant to #122 about boost deprecated warnings

  brettviren

  committed
  5e3b017

  Copy full SHA for 5e3b017

• Cherry pick 'option for skipping the roi refinement'

  Show description for 2bd197e
  

  wenqiang-gu

  authored and

  brettviren

  committed
  2bd197e

  Copy full SHA for 2bd197e

• Merge pull request #119 from WireCell/fixes-and-additions

  Show description for fa10162
  HaiwangYu

  authored
  fa10162

  Copy full SHA for fa10162

• Merge pull request #108 from HaiwangYu/dune-vd

  Show description for cd69626
  HaiwangYu

  authored
  cd69626

  Copy full SHA for cd69626

Commits on Aug 18, 2021

• merge

  HaiwangYu

  committed
  4878f9b

  Copy full SHA for 4878f9b

Commits on Aug 20, 2021

• add IDepoSetFilter and IDepoSetSource.h

  HaiwangYu

  committed
  8d5cde0

  Copy full SHA for 8d5cde0

• update

  HaiwangYu

  committed
  364a367

  Copy full SHA for 364a367

• to be complete

  HaiwangYu

  committed
  1e28e02

  Copy full SHA for 1e28e02

• to be complete

  HaiwangYu

  committed
  31e7580

  Copy full SHA for 31e7580

• Merge pull request #123 from HaiwangYu/dev

  Show description for c4e465f
  brettviren

  authored
  c4e465f

  Copy full SHA for c4e465f

• Logging tweaks while chasing some imaging bug

  brettviren

  committed
  7879dbb

  Copy full SHA for 7879dbb

• Merge branch 'master' of github.com:wirecell/wire-cell-toolkit

  brettviren

  committed
  0ed7199

  Copy full SHA for 0ed7199

Commits on Aug 23, 2021

• Improve logging and let components know their name.

  Show description for 90ad049
  brettviren

  committed
  90ad049

  Copy full SHA for 90ad049

• Replace ignored and unactionable cerr with a return of the

  Show description for 9f5dc5e
  brettviren

  committed
  9f5dc5e

  Copy full SHA for 9f5dc5e

• Add a version string.

  Show description for c77c8a6
  brettviren

  committed
  c77c8a6

  Copy full SHA for c77c8a6

• Remove vestigial python/ sub package.

  Show description for 79d7ff1
  brettviren

  committed
  79d7ff1

  Copy full SHA for 79d7ff1

Commits on Aug 24, 2021

• Possibly fix the out-of-order problem with split_node

  Show description for 7e147b0
  brettviren

  committed
  7e147b0

  Copy full SHA for 7e147b0

Commits on Aug 25, 2021

• Maybe for real fix the out-of-order problem.

  Show description for a9f336b
  brettviren

  committed
  a9f336b

  Copy full SHA for a9f336b

Commits on Aug 26, 2021

• Fix template specializations to be inline

  brettviren

  committed
  9c1e05b

  Copy full SHA for 9c1e05b

• Add frame file source for #111. Needs testing

  brettviren

  committed
  b5cc10c

  Copy full SHA for b5cc10c

• Clean and test frame file source. Fix #111.

  brettviren

  committed
  8c6d7ae

  Copy full SHA for 8c6d7ae

• Simplest DepoSetDrifter using a Drifter

  Show description for fa04dd3
  brettviren

  committed
  fa04dd3

  Copy full SHA for fa04dd3

• Add depo set loader and fix depo set drifter

  brettviren

  committed
  f5e48bf

  Copy full SHA for f5e48bf

Commits on Aug 27, 2021

• Merge pull request #127 from WireCell/fixes-and-additions2

  Show description for 462511e
  brettviren

  authored
  462511e

  Copy full SHA for 462511e

• Merge remote-tracking branch 'origin/master'

  brettviren

  committed
  5ba97af

  Copy full SHA for 5ba97af

• Merge pull request #129 from WireCell/fixes-and-additions3

  Show description for 40dc839
  brettviren

  authored
  40dc839

  Copy full SHA for 40dc839

Commits on Sep 8, 2021

• Adjust C-API calling code according to go-jsonnet's C bindings.

  knoepfel

  committed
  4a77094

  Copy full SHA for 4a77094

• Merge pull request #130 from knoepfel/c-api-adjustments

  Show description for e348f27
  brettviren

  authored
  e348f27

  Copy full SHA for e348f27

Commits on Oct 7, 2021

• Add depo set file source/sink using tar stream of numpy files

  brettviren

  committed
  3ba1002

  Copy full SHA for 3ba1002

Commits on Oct 8, 2021

• Add depo set file source/sink using tar stream of numpy files

  brettviren

  committed
  21015dc

  Copy full SHA for 21015dc

Commits on Oct 11, 2021

• Merge branch 'hybrid-wcls' of github.com:WireCell/wire-cell-toolkit into hybrid-wcls

  brettviren

  committed
  9395cd5

  Copy full SHA for 9395cd5

Commits on Oct 12, 2021

• Add test for load failures and update wcb/waf-tools to handle new libtorch.

  Show description for d3d94b6
  brettviren

  committed
  d3d94b6

  Copy full SHA for d3d94b6

• Only do special linking if torch_cuda is used

  brettviren

  committed
  f7afb12

  Copy full SHA for f7afb12

Commits on Oct 15, 2021

• Convert to logger, fix timing measurements

  brettviren

  committed
  bf53e7b

  Copy full SHA for bf53e7b

Commits on Oct 16, 2021

• Some flailing to avoid torch error about data on both cpu and cuda.

  Show description for 06c5933
  brettviren

  committed
  06c5933

  Copy full SHA for 06c5933

• Checkpoint

  brettviren

  committed
  47e13aa

  Copy full SHA for 47e13aa

• Merge branch 'hybrid-wcls' of github.com:WireCell/wire-cell-toolkit into hybrid-wcls

  brettviren

  committed
  27327f5

  Copy full SHA for 27327f5

• Add torch service currently with DRF using it or optionally the old torch script node

  Show description for 4e93222
  brettviren

  committed
  4e93222

  Copy full SHA for 4e93222

Commits on Oct 18, 2021

• Semaphore and torch device cleanups

  brettviren

  committed
  cb608c8

  Copy full SHA for cb608c8

• Make threshold configurable

  brettviren

  committed
  5c1fa11

  Copy full SHA for 5c1fa11

Commits on Oct 20, 2021

• Add scale setting intended to allow charge sign flipping. See #133 for details.

  brettviren

  committed
  9c08877

  Copy full SHA for 9c08877

• Give 'trivial' mode where full frame is fanned without tag fules

  brettviren

  committed
  4bdbe66

  Copy full SHA for 4bdbe66

• Clarify log/error message and improve the temporary debug dependency on HDF5 to remove illegal cross dependency on hio

  brettviren

  committed
  afa2b63

  Copy full SHA for afa2b63

• Add options to save frames as 'dense'.

  brettviren

  committed
  7cdbb04

  Copy full SHA for 7cdbb04

• Quiet some output

  brettviren

  committed
  7d11aa4

  Copy full SHA for 7d11aa4

Commits on Oct 21, 2021

• Logging cleanups and give channel selector optional tag rules

  brettviren

  committed
  79d42d6

  Copy full SHA for 79d42d6

Commits on Oct 22, 2021

• Clarify cbeg and cend as being relative to the smallest channel ID in the anode plane

  Show description for 625e7f1
  brettviren

  committed
  625e7f1

  Copy full SHA for 625e7f1

Commits on Oct 26, 2021

• Add ability to select traces by plane.

  Show description for e86d1c6
  brettviren

  committed
  e86d1c6

  Copy full SHA for e86d1c6

Commits on Oct 28, 2021

• Improve tag handling in plane selector, add message if non-unity output scale is used in dnnroi

  brettviren

  committed
  21cf05e

  Copy full SHA for 21cf05e

• Make it an Aux::Logger

  brettviren

  committed
  90eb3d0

  Copy full SHA for 90eb3d0

• Add test of pdsp sim sp dnnroi and a suite of new 'helper' configuration functions

  brettviren

  committed
  ad74e14

  Copy full SHA for ad74e14

Commits on Nov 11, 2021

• Merge pull request #131 from WireCell/hybrid-wcls

  Show description for a966fcb
  HaiwangYu

  authored
  a966fcb

  Copy full SHA for a966fcb

Commits on Dec 6, 2021

• Make test executable

  brettviren

  committed
  551840d

  Copy full SHA for 551840d

• Very first step of schema based configuration.

  brettviren

  committed
  2cb4a17

  Copy full SHA for 2cb4a17

• Break each schema into its own pair of headers

  brettviren

  committed
  b9b53c0

  Copy full SHA for b9b53c0

• Merge fixes after rebase cfgschema branch on top of recent master

  brettviren

  committed
  ec8d88f

  Copy full SHA for ec8d88f

• Add generation of Jsonnet constructor functions

  brettviren

  committed
  77c5cb1

  Copy full SHA for 77c5cb1

• Fix regressions in TrackDepos and convert Ductor and DepoSplat

  brettviren

  committed
  2fba70c

  Copy full SHA for 2fba70c

• Add codegen to wscript, needing a naming convention change

  Show description for 980f8b4
  brettviren

  committed
  980f8b4

  Copy full SHA for 980f8b4

• Remove now undeeded manual script, update readme to match

  brettviren

  committed
  b967cc7

  Copy full SHA for b967cc7

• More conversion to schema

  brettviren

  committed
  898f355

  Copy full SHA for 898f355

• Merge fixes

  brettviren

  committed
  a9382cd

  Copy full SHA for a9382cd

Commits on Dec 7, 2021

• Get config schema branch building again after rebase and add Aux::Configurable base class

  brettviren

  committed
  083a081

  Copy full SHA for 083a081

• Make single header for each schema which combines structs and nljs

  brettviren

  committed
  78bb231

  Copy full SHA for 78bb231

• Schema-based config, back on track

  brettviren

  committed
  ff7874c

  Copy full SHA for ff7874c

Commits on Dec 8, 2021

• Edits

  brettviren

  committed
  bde5e82

  Copy full SHA for bde5e82