Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Some questions about Backdoor Bench #756

Open
tntstation opened this issue Feb 17, 2024 · 2 comments
Open

Some questions about Backdoor Bench #756

tntstation opened this issue Feb 17, 2024 · 2 comments
Assignees

Comments

@tntstation
Copy link

hello!
Recently,I found some issues when trying to reproduce the experiment in Revisiting Personalized Federated Learning: Robustness Against Backdoor Attacks.
The output is a complex number result, and the evaluator assesses the test_acc and poison_acc for each client. However, in the paper's charts, it appears that only one model was evaluated. Did you select specific clients or perform some kind of processing?
Thanks

@yxdyc yxdyc assigned yxdyc and Osier-Yi and unassigned yxdyc Feb 29, 2024
@yxdyc
Copy link
Collaborator

yxdyc commented Feb 29, 2024

@Alan-Qin zeyu, you can have a look when you are available.

@Alan-Qin
Copy link
Contributor

Alan-Qin commented Mar 2, 2024

Hi,
In our paper and experiments, we take the evaluation on all client and compute the average value of all client's clean acc and poisoning acc.

Could you please show all details about your issues?

Bests,
Zeyu

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants