Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create Multi-Objective Black-Box Optimization Benchmarks #5

Closed
Deathn0t opened this issue Mar 10, 2023 · 3 comments
Closed

Create Multi-Objective Black-Box Optimization Benchmarks #5

Deathn0t opened this issue Mar 10, 2023 · 3 comments
Assignees

Comments

@Deathn0t
Copy link
Member

Similarly to C-BBO benchmarks some continuous benchmarks for continuous black-box optimization can should be created. They could be added in the same folder as C-BBO with some specific prefix/suffix to show that they are Multi-Objectives. Then the C-BBO table can be updated accordingly.

@Deathn0t
Copy link
Member Author

Merged #8 which adds the DTLZBenchmark for MOO.

@Deathn0t
Copy link
Member Author

Deathn0t commented Jun 9, 2023

Are JAHS-Bench problems working or do we still need to work on it?

@thchang
Copy link
Contributor

thchang commented Jun 9, 2023

FYI, I think this probably belongs under #6 and we should close this issue, but to answer your question:

Yes I JAHS-Bench working in DeepHyper in my fork:

https://github.com/thchang/benchmark/tree/main/lib/JAHSBench

Need to make some small modifications to let user set problem params from CL and download datasets on install, but otherwise it is working. Note that JAHS-Bench doesn't work on MacOS, so that is one limitation without any workaround.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants