Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Range-based metrics #44

Open
LouisCarpentier42 opened this issue Nov 28, 2024 · 0 comments
Open

Range-based metrics #44

LouisCarpentier42 opened this issue Nov 28, 2024 · 0 comments
Labels
evaluation metric Implement a new evaluation metric

Comments

@LouisCarpentier42
Copy link
Collaborator

Implement Range-based precision, recall and F1 [1] to evaluate anomaly detection performance. Traditional precision and recall consider each point independently, and therefore do not take temporal dependencies in time series into account. People have proposed point-adjusting the predicitons, in which an entire anomalous event is considered detected, if any of the individial points are predicted to be an anomaly. This point-adjustement does, however, largely overestimate the performance of anomaly detectors and may lead to random detectors outperforming state-of-the-art. The range-based metrics proposed in [1] overcome such issues by considering the temporal nature of time series.

[1] N. Tatbul, T. J. Lee, S. Zdonik, M. Alam, and J. Gottschlich. Precision and recall for time series. Advances in neural information processing systems, 31, 2018.

@LouisCarpentier42 LouisCarpentier42 added the evaluation metric Implement a new evaluation metric label Nov 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
evaluation metric Implement a new evaluation metric
Projects
None yet
Development

No branches or pull requests

1 participant