Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ENH] sync skpro and sktime probabilistic metrics modules #367

Open
fkiraly opened this issue May 26, 2024 · 0 comments
Open

[ENH] sync skpro and sktime probabilistic metrics modules #367

fkiraly opened this issue May 26, 2024 · 0 comments
Labels
enhancement maintenance Continuous integration, unit testing & package distribution module:metrics&benchmarking metrics and benchmarking modules

Comments

@fkiraly
Copy link
Collaborator

fkiraly commented May 26, 2024

We need to sync the skpro and sktime probabilistic metrics modules.

Synchronization points:

  • ensure handling of weights like in sktime, e.g., via _groupby_dot
  • ensure consistent output type handling, e.g., in evaluate
  • possibly for later: consider vectorization over MultiIndex entries - this is required for rebasing sktime proba metrics on skpro
  • ensure new probabilistic metrics in sktime are also present in skpro, e.g., calibration or sharpness
@fkiraly fkiraly added enhancement maintenance Continuous integration, unit testing & package distribution module:metrics&benchmarking metrics and benchmarking modules labels May 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement maintenance Continuous integration, unit testing & package distribution module:metrics&benchmarking metrics and benchmarking modules
Projects
None yet
Development

No branches or pull requests

1 participant