This repo uses PyTorch's native distributed module in an implementation of federated learning.
It comes with a few experimental setups; various Residual Networks on CIFAR10, CIFAR100, FEMNIST, ImageNet (cv_train.py) and GPT2 on PersonaChat (gpt2_train.py).
There are a variety of command-line args which are best examined by looking at utils.py
The server is contained in fed_aggregator.py and the worker is contained in fed_worker.py
Other relevant branches: attacks contains an implementation of a malicious model poisoning adversary.
To use sketching, you need to install https://github.com/nikitaivkin/csh