This repository contains a roadmap for beginner's to start their journey on Federated Learning. Self-curated. The difficulty will be moderate and expects prior knowledge about Python and Deep Learning concepts.
-
Start off with this funny and insightful comic on Federated Learning by Google AI. The same site contains a list of learning resources and research done by Google on Federated Learning.
-
The first paper on Federated learning was by Google Inc in 2017. The authors presented a new learning paradigm where the data remains distributed in several mobile devices but the model is trained in a decentralized way. Instead of data moving to a centralized server, the model moves to distributed devices. Quoting from the Abstract (had to mention it lol):
We advocate an alternative that leaves the training data distributed on the mobile devices, and learns a shared model by aggregating locally-computed updates. We term this decentralized approach Federated Learning.
Blog: Federated Learning: Collaborative Machine Learning without Centralized Training Data
Paper: Communication-efficient learning of deep networks from decentralized data
Read the blog first, to get an overall picture of the work, then jump on to the paper for the nitty-gritty details.
-
The next paper is again by Google Research. This time the paper deals with Keyword Prediction
In the order of ease of usage (currently trying Flower, Syft and TF-Federated, will update the order):
- Flower by Flower Labs
- TensorFlow Federated by Google PARFAIT
- PySyft by OpenMined
- FATE by FedAI Ecosystem
- CLARA by NVIDIA
- Substra by Owkin
- [DL.AI X Flower Labs, Short Course on Intro to Federated Learning]
- [DL.AI X Flower Labs, Short Course on Federated Fine-tuning of LLMs with Private Data]
- Federated GitHub by Google Research:A collection of Google research projects related to Federated Learning and Federated Analytics.
- The Federated Learning Portal: This portal keeps track of books, workshops, conferences, special tracks, and other events related to the field of FL. I came to know about many competitions in the domain of FL from this webpage.
- OpenMined Slack
- Flower Labs Slack
- FedML Discord
- OpenMined
- Flower Labs
- Owkin