Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow to register multiple metrics for one validation (yaml input) #20

Open
2 of 3 tasks
jm-cc opened this issue May 19, 2020 · 0 comments
Open
2 of 3 tasks

Allow to register multiple metrics for one validation (yaml input) #20

jm-cc opened this issue May 19, 2020 · 0 comments
Labels
enhancement New feature or request

Comments

@jm-cc
Copy link
Owner

jm-cc commented May 19, 2020

Currently only one metric is associated with an executable in the Validation list.

An executable may generate more than one metric, it should be possible to register them on the right entry rather than creating fake entries.

today :

(...)
      Validations:
        - id: metric-1
          type: configuration_independent
          reference : 100
          tolerance: 0.03
          executable: actual_executable
        - id: "metric-2"
          reference: 88.3
          type: configuration_independent
          tolerance: 0.1
          executable: true # noop executable since the metric is generated with previous validation.

wanted :

(...)
      Validations:
        executable : actual_executable
        metrics : 
          - {id : metric-1, reference : 100, type : configuration_independent, tolerance: 0.03}
          - {id : metric-2, reference : 88,3, type : configuration_independent, tolerance: 0.01}

Previous syntax for validation with only one metric will still be valid.

TODO

  • Implement
  • Example in gcvb-examples
  • Write documentation
@jm-cc jm-cc added the enhancement New feature or request label May 19, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant