Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Idea for a two step preprocessing pipeline #100

Open
perib opened this issue Oct 3, 2023 · 0 comments
Open

Idea for a two step preprocessing pipeline #100

perib opened this issue Oct 3, 2023 · 0 comments
Labels
enhancement New feature or request

Comments

@perib
Copy link
Collaborator

perib commented Oct 3, 2023

Currently, the preprocessing pipeline is applied to the entire training set before the evolution of pipelines. This is fine for things like one hot encoding.

We may want some parts of preprocessing to be trained per fold of cross-validation, such as iterative imputer. However, this is expensive and should be done only once.

This is something we may consider implementing into TPOT2. However, it is also something users can implement themselves as a custom objective function as well.

@perib perib added the enhancement New feature or request label Oct 3, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant