Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fit semi-supervised on test data? #59

Open
LouisCarpentier42 opened this issue Dec 6, 2024 · 0 comments
Open

Fit semi-supervised on test data? #59

LouisCarpentier42 opened this issue Dec 6, 2024 · 0 comments
Labels
Workflow Improvements regarding the workflow

Comments

@LouisCarpentier42
Copy link
Collaborator

In the Workflow, there is a flag to fit unsupervised detectors on the test data directly (fit_unsupervised_on_test_data). This is no problem as the methods are unsupervised and thus do not use any ground truth labels.

Would it be possible to add a similar flag for semi-supervised methods (fit_semi_supervised_on_test_data)? For these methods, a train set consisting of normal data is used to avoid learning anomalous behavior. However, it could also be possible to train directly on the test set (ignoring that the trainings data should be normal), and then also predict on this same set. This way, you can also analyze the robustness of a semi-supervised anomaly detector against anomalies in the training data.

This should be a relatively easy addition. The main question is whether this functionality is desirable or not.

@LouisCarpentier42 LouisCarpentier42 added the Workflow Improvements regarding the workflow label Dec 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Workflow Improvements regarding the workflow
Projects
None yet
Development

No branches or pull requests

1 participant