Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(baselines) Add flwr baseline fedht #4398

Open
wants to merge 109 commits into
base: main
Choose a base branch
from

Conversation

chancejohnstone
Copy link

@chancejohnstone chancejohnstone commented Oct 30, 2024

Issue

Adding Fed-HT (and FedIter-HT) baseline originally introduced in:

Tong, Q., Liang, G., Zhu, T. and Bi, J., 2020. Federated nonconvex sparse learning. arXiv preprint arXiv:2101.00052.

Description

Fed-HT (and Fed-IterHT) are aggregation strategies for generating highly predictive models while also allowing for constrained sparsity (with some sparsity threshold parameter), instead of just sparsity through regularization. The goal with this baseline is to implement Fed-HT and Fed-IterHT as a custom Flower aggregation strategy and apply to simulated and benchmark datasets from the paper.

Related issues/PRs

This PR is related to the following PR: Add Flower Baseline: FedHT #3987

Proposal

Proposing to merge local fork with Flower repo to include fedht baseline in future Flower versions.

Checklist

  • Implement proposed change
  • Write tests
  • Update documentation
  • Make CI checks pass
  • Ping maintainers on Slack (channel #contributions)

Comments

Results from paper not reproduced exactly as hyperparameters for figures are not identified. Waiting on response from original authors.

@chancejohnstone
Copy link
Author

chancejohnstone commented Dec 4, 2024

@jafermarq I think I've resolved the reproducibility issues with Simulation II; visuals in README have been updated to reflect this. I've also removed the inclusion of Dist-IHT just because it's a special case of Fed-HT.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants