Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Deepspeed #42

Closed
wants to merge 96 commits into from
Closed

Deepspeed #42

wants to merge 96 commits into from

Conversation

porteratzo
Copy link
Collaborator

No description provided.

akantak and others added 30 commits April 20, 2023 12:15
C419 Unnecessary list comprehension passed to any()/all() prevents short-circuiting - rewrite as a generator

Signed-off-by: Aleksander Kantak <[email protected]>
* Fix warnings and issues in docs

Signed-off-by: Aleksander Kantak <[email protected]>

* fixup! Fix warnings and issues in docs

Signed-off-by: Aleksander Kantak <[email protected]>

---------

Signed-off-by: Aleksander Kantak <[email protected]>
* Add Logo

* Update README.md
…ratedai#809)

This replaces the font of OpenFL documents with Intel One Mono font for low vision developers.

    Known issues:
    1. The text font within the images has not been changed.
    2. Some icons that do not exist in the new font cannot be displayed properly.

    Fixes securefederatedai#799

    Co-authored-by: Wang, Le <[email protected]>
    Signed-off-by: He, Dan H <[email protected]>
    Signed-off-by: Jiang, Jiaqiu <[email protected]>
    Signed-off-by: Li, Qingqing <[email protected]>
    Signed-off-by: Wang, Le <[email protected]>
    Signed-off-by: Wu, Caili <[email protected]>

Signed-off-by: He, Dan H <[email protected]>
Co-authored-by: He, Dan H <[email protected]>
* Update ci config

Signed-off-by: Fang, Xiaoran <[email protected]>

* Add unit test for following files

- openfl/federated/plan/plan.py
- openfl/interface/aggregation_functions/core/adaptive_aggregation.py

Signed-off-by: Fang, Xiaoran <[email protected]>

* Add some test cases for databases module

Signed-off-by: Fang, Xiaoran <[email protected]>

* Fix bugs for databases module unittest

Signed-off-by: Fang, Xiaoran <[email protected]>

* Update unit tests for component module

Signed-off-by: Fang, Xiaoran <[email protected]>

* Restore workflow config and update some comments

Signed-off-by: Fang, Xiaoran <[email protected]>

* Enable save_ test case.
Add yaml under test dir for unit test usage.

Signed-off-by: Fang, Xiaoran <[email protected]>

* Remove plan to new dir.

Signed-off-by: Fang, Xiaoran <[email protected]>

* Remove plan to new dir.

Signed-off-by: Fang, Xiaoran <[email protected]>

* Add aggregator start test cases.

Signed-off-by: Fang, Xiaoran <[email protected]>

* Add 2 aggregator test cases.

Signed-off-by: Fang, Xiaoran <[email protected]>

* Add 1 aggregator test case.

Signed-off-by: Fang, Xiaoran <[email protected]>

* Format code.

Signed-off-by: Fang, Xiaoran <[email protected]>

* Refactor code.

Signed-off-by: Fang, Xiaoran <[email protected]>

* Add collaborator start test cases.

Signed-off-by: Fang, Xiaoran <[email protected]>

* Add 1 collaborator test case.

Signed-off-by: Fang, Xiaoran <[email protected]>

* Format with flake8

Signed-off-by: Fang, Xiaoran <[email protected]>

* Remove TODO comments

Signed-off-by: Fang, Xiaoran <[email protected]>

---------

Signed-off-by: Fang, Xiaoran <[email protected]>
Co-authored-by: Wang, Wenjie <[email protected]>
Co-authored-by: Lei5 Chen <[email protected]>
This adds a new tutorial example on distributing a linear regression task over OpenFL cluster.

    The model is defined by Pytorch which is able to run over both cpu (by default) and gpu. The dataset is generated by make_regression from sklearn.datasets with pre-defined parameters.

    Fixes securefederatedai#797

    Co-authored-by: Jiang, Jiaqiu <[email protected]>
    Signed-off-by: He, Dan H <[email protected]>
    Signed-off-by: Jiang, Jiaqiu <[email protected]>
    Signed-off-by: Li, Qingqing <[email protected]>
    Signed-off-by: Wang, Le <[email protected]>
    Signed-off-by: Wu, Caili <[email protected]>

Signed-off-by: He, Dan H <[email protected]>
…nd (securefederatedai#813)

* This prints out the hash of the CSR to disk for both the aggregator and
collaborator. The user then compares and approves this hash with the
hash printed out of the file to validate the CSR. In addition, a warning
message is pritned if certify is run in silent mode.

Fixes securefederatedai#692

Signed-off-by: Grant Baker <[email protected]>

* Refactor read_csr function to use get_csr_hash

Signed-off-by: Grant Baker <[email protected]>

* Ask to check hashes before prompt

---------

Signed-off-by: Grant Baker <[email protected]>
Co-authored-by: Grant Baker <[email protected]>
Remove the dump_requirement_file operation in export_ method.

            Fixes securefederatedai#767

            Co-authored-by: Li, Qingqing <[email protected]>
            Co-authored-by: Wu, Caili <[email protected]>
            Signed-off-by: He, Dan H <[email protected]>
            Signed-off-by: Jiang, Jiaqiu <[email protected]>
            Signed-off-by: Li, Qingqing <[email protected]>
            Signed-off-by: Wang, Le <[email protected]>
            Signed-off-by: Wu, Caili <[email protected]>

Signed-off-by: He, Dan H <[email protected]>
* created new ineractive_api dir to hold pytorch fedprox mnist example

corrected files

changed to FedProxOptimizer and ran set_old_weights for new FedProx Pytorch example

renamed FedProx notebook

used mode.parrameters() to get pytorch model weights

got weights using state_dict

changed old wieghts to list (for serialization) and fixed README

input wieghts before zero_grad

[Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api

This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.

Fixes: securefederatedai#506

Signed-off-by: Klemme, Beverly <[email protected]>
Signed-off-by: Baker, Grant <[email protected]>
Signed-off-by: ELizabeth Simon, Neethu <[email protected]>
Signed-off-by: Jillela, Emmanuel <[email protected]>
Signed-off-by: Beverly Klemme <[email protected]>

* [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api

This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.

Fixes: securefederatedai#506

Signed-off-by: Klemme, Beverly <[email protected]>
Signed-off-by: Baker, Grant <[email protected]>
Signed-off-by: Elizabeth Simon, Neethu <[email protected]>
Signed-off-by: Jillela, Emmanuel <[email protected]>
Signed-off-by: Beverly Klemme <[email protected]>

* Update README.md

Signed-off-by: Beverly Klemme <[email protected]>

* addressed comments by psfoley: corrected words in the jupyter notebook metadata and added a link to the FedProx paper in the README.

Signed-off-by: Beverly Klemme <[email protected]>

---------

Signed-off-by: Klemme, Beverly <[email protected]>
Signed-off-by: Baker, Grant <[email protected]>
Signed-off-by: ELizabeth Simon, Neethu <[email protected]>
Signed-off-by: Jillela, Emmanuel <[email protected]>
Signed-off-by: Beverly Klemme <[email protected]>
Signed-off-by: Elizabeth Simon, Neethu <[email protected]>
…dai#807)

This change separates existing command
"fx collaborator.py generate-cert-request" command into two
commands.
"fx collaborator create -n {NAME} -d {DATA_PATH: optional}".
"fx collaborator generate-cert-request -n {NAME}".

Fixes securefederatedai#768

Signed-off-by: Emmanuel Jillela <[email protected]>
Co-authored-by: Emmanuel Jillela <[email protected]>
…#812)

* Add new tutorial example to OpenFL interactive API

This adds a new tutorial example on distributing a linear regression task over OpenFL cluster

The model is defined by scikit-learn which is able to run over both cpu (by default) and gpu. The dataset is 1-dimensional noisy data of sinusoid with pre-defined parameters.

Fixes securefederatedai#798

Co-authored-by: Beverly Klemme <[email protected]>
Co-authored-by: Grant Baker <[email protected]>

Signed-off-by: Yi CAO <[email protected]>

* reduced requirements.txt in workspace

Signed-off-by: Beverly Klemme <[email protected]>

---------

Signed-off-by: Yi CAO <[email protected]>
Signed-off-by: Beverly Klemme <[email protected]>
Co-authored-by: Yi CAO <[email protected]>
…ecurefederatedai#776)

Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](tensorflow/tensorflow@v2.9.3...v2.11.1)

---
updated-dependencies:
- dependency-name: tensorflow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](tensorflow/tensorflow@v2.9.3...v2.11.1)

---
updated-dependencies:
- dependency-name: tensorflow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Initial commit of Running the federation with GaNDLF Documentation

Signed-off-by: Patrick Foley <[email protected]>

* Update docs/running_the_federation_with_gandlf.rst

Co-authored-by: Sarthak Pati <[email protected]>
Signed-off-by: Patrick Foley <[email protected]>

* Update docs/running_the_federation_with_gandlf.rst

Co-authored-by: Sarthak Pati <[email protected]>
Signed-off-by: Patrick Foley <[email protected]>

* Update docs/running_the_federation_with_gandlf.rst

Co-authored-by: Sarthak Pati <[email protected]>
Signed-off-by: Patrick Foley <[email protected]>

* Update docs/running_the_federation_with_gandlf.rst

Co-authored-by: Sarthak Pati <[email protected]>
Signed-off-by: Patrick Foley <[email protected]>

* Update docs/running_the_federation_with_gandlf.rst

Co-authored-by: Sarthak Pati <[email protected]>
Signed-off-by: Patrick Foley <[email protected]>

* Update docs/running_the_federation_with_gandlf.rst

Co-authored-by: Sarthak Pati <[email protected]>
Signed-off-by: Patrick Foley <[email protected]>

* Update docs/running_the_federation_with_gandlf.rst

Co-authored-by: Sarthak Pati <[email protected]>
Signed-off-by: Patrick Foley <[email protected]>

* Update docs/running_the_federation_with_gandlf.rst

Co-authored-by: Sarthak Pati <[email protected]>
Signed-off-by: Patrick Foley <[email protected]>

* Update docs/running_the_federation_with_gandlf.rst

Co-authored-by: Sarthak Pati <[email protected]>
Signed-off-by: Patrick Foley <[email protected]>

* Update docs/running_the_federation_with_gandlf.rst

Co-authored-by: Sarthak Pati <[email protected]>
Signed-off-by: Patrick Foley <[email protected]>

* Update README.md

Removed references to Intel's ownship, given it's now owned by the LF AI and Data.

Signed-off-by: Patrick Foley <[email protected]>

* Fix Flake8 C419 for Ubuntu CI (securefederatedai#800)

C419 Unnecessary list comprehension passed to any()/all() prevents short-circuiting - rewrite as a generator

Signed-off-by: Aleksander Kantak <[email protected]>
Signed-off-by: Patrick Foley <[email protected]>

* Update README.md

Signed-off-by: Patrick Foley <[email protected]>

* Fix warnings and issues in docs (securefederatedai#825)

* Fix warnings and issues in docs

Signed-off-by: Aleksander Kantak <[email protected]>

* fixup! Fix warnings and issues in docs

Signed-off-by: Aleksander Kantak <[email protected]>

---------

Signed-off-by: Aleksander Kantak <[email protected]>
Signed-off-by: Patrick Foley <[email protected]>

* Add Logo (securefederatedai#827)

* Add Logo

* Update README.md

Signed-off-by: Patrick Foley <[email protected]>

* Change OpenFL documentation font to improve accessibility (securefederatedai#809)

This replaces the font of OpenFL documents with Intel One Mono font for low vision developers.

    Known issues:
    1. The text font within the images has not been changed.
    2. Some icons that do not exist in the new font cannot be displayed properly.

    Fixes securefederatedai#799

    Co-authored-by: Wang, Le <[email protected]>
    Signed-off-by: He, Dan H <[email protected]>
    Signed-off-by: Jiang, Jiaqiu <[email protected]>
    Signed-off-by: Li, Qingqing <[email protected]>
    Signed-off-by: Wang, Le <[email protected]>
    Signed-off-by: Wu, Caili <[email protected]>

Signed-off-by: He, Dan H <[email protected]>
Co-authored-by: He, Dan H <[email protected]>
Signed-off-by: Patrick Foley <[email protected]>

* Update unit tests to improve code coverage (securefederatedai#821)

* Update ci config

Signed-off-by: Fang, Xiaoran <[email protected]>

* Add unit test for following files

- openfl/federated/plan/plan.py
- openfl/interface/aggregation_functions/core/adaptive_aggregation.py

Signed-off-by: Fang, Xiaoran <[email protected]>

* Add some test cases for databases module

Signed-off-by: Fang, Xiaoran <[email protected]>

* Fix bugs for databases module unittest

Signed-off-by: Fang, Xiaoran <[email protected]>

* Update unit tests for component module

Signed-off-by: Fang, Xiaoran <[email protected]>

* Restore workflow config and update some comments

Signed-off-by: Fang, Xiaoran <[email protected]>

* Enable save_ test case.
Add yaml under test dir for unit test usage.

Signed-off-by: Fang, Xiaoran <[email protected]>

* Remove plan to new dir.

Signed-off-by: Fang, Xiaoran <[email protected]>

* Remove plan to new dir.

Signed-off-by: Fang, Xiaoran <[email protected]>

* Add aggregator start test cases.

Signed-off-by: Fang, Xiaoran <[email protected]>

* Add 2 aggregator test cases.

Signed-off-by: Fang, Xiaoran <[email protected]>

* Add 1 aggregator test case.

Signed-off-by: Fang, Xiaoran <[email protected]>

* Format code.

Signed-off-by: Fang, Xiaoran <[email protected]>

* Refactor code.

Signed-off-by: Fang, Xiaoran <[email protected]>

* Add collaborator start test cases.

Signed-off-by: Fang, Xiaoran <[email protected]>

* Add 1 collaborator test case.

Signed-off-by: Fang, Xiaoran <[email protected]>

* Format with flake8

Signed-off-by: Fang, Xiaoran <[email protected]>

* Remove TODO comments

Signed-off-by: Fang, Xiaoran <[email protected]>

---------

Signed-off-by: Fang, Xiaoran <[email protected]>
Co-authored-by: Wang, Wenjie <[email protected]>
Co-authored-by: Lei5 Chen <[email protected]>
Signed-off-by: Patrick Foley <[email protected]>

* Add PyTorch linear regression example (securefederatedai#808)

This adds a new tutorial example on distributing a linear regression task over OpenFL cluster.

    The model is defined by Pytorch which is able to run over both cpu (by default) and gpu. The dataset is generated by make_regression from sklearn.datasets with pre-defined parameters.

    Fixes securefederatedai#797

    Co-authored-by: Jiang, Jiaqiu <[email protected]>
    Signed-off-by: He, Dan H <[email protected]>
    Signed-off-by: Jiang, Jiaqiu <[email protected]>
    Signed-off-by: Li, Qingqing <[email protected]>
    Signed-off-by: Wang, Le <[email protected]>
    Signed-off-by: Wu, Caili <[email protected]>

Signed-off-by: He, Dan H <[email protected]>
Signed-off-by: Patrick Foley <[email protected]>

* This prints out the hash of the CSR to disk for both the aggregator and (securefederatedai#813)

* This prints out the hash of the CSR to disk for both the aggregator and
collaborator. The user then compares and approves this hash with the
hash printed out of the file to validate the CSR. In addition, a warning
message is pritned if certify is run in silent mode.

Fixes securefederatedai#692

Signed-off-by: Grant Baker <[email protected]>

* Refactor read_csr function to use get_csr_hash

Signed-off-by: Grant Baker <[email protected]>

* Ask to check hashes before prompt

---------

Signed-off-by: Grant Baker <[email protected]>
Co-authored-by: Grant Baker <[email protected]>

Signed-off-by: Patrick Foley <[email protected]>

* Improve workspace requirements import (securefederatedai#810)

Remove the dump_requirement_file operation in export_ method.

            Fixes securefederatedai#767

            Co-authored-by: Li, Qingqing <[email protected]>
            Co-authored-by: Wu, Caili <[email protected]>
            Signed-off-by: He, Dan H <[email protected]>
            Signed-off-by: Jiang, Jiaqiu <[email protected]>
            Signed-off-by: Li, Qingqing <[email protected]>
            Signed-off-by: Wang, Le <[email protected]>
            Signed-off-by: Wu, Caili <[email protected]>

Signed-off-by: He, Dan H <[email protected]>
Signed-off-by: Patrick Foley <[email protected]>

* Issue 506 Added Example using FedProx (securefederatedai#818)

* created new ineractive_api dir to hold pytorch fedprox mnist example

corrected files

changed to FedProxOptimizer and ran set_old_weights for new FedProx Pytorch example

renamed FedProx notebook

used mode.parrameters() to get pytorch model weights

got weights using state_dict

changed old wieghts to list (for serialization) and fixed README

input wieghts before zero_grad

[Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api

This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.

Fixes: securefederatedai#506

Signed-off-by: Klemme, Beverly <[email protected]>
Signed-off-by: Baker, Grant <[email protected]>
Signed-off-by: ELizabeth Simon, Neethu <[email protected]>
Signed-off-by: Jillela, Emmanuel <[email protected]>
Signed-off-by: Beverly Klemme <[email protected]>

* [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api

This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.

Fixes: securefederatedai#506

Signed-off-by: Klemme, Beverly <[email protected]>
Signed-off-by: Baker, Grant <[email protected]>
Signed-off-by: Elizabeth Simon, Neethu <[email protected]>
Signed-off-by: Jillela, Emmanuel <[email protected]>
Signed-off-by: Beverly Klemme <[email protected]>

* Update README.md

Signed-off-by: Beverly Klemme <[email protected]>

* addressed comments by psfoley: corrected words in the jupyter notebook metadata and added a link to the FedProx paper in the README.

Signed-off-by: Beverly Klemme <[email protected]>

---------

Signed-off-by: Klemme, Beverly <[email protected]>
Signed-off-by: Baker, Grant <[email protected]>
Signed-off-by: ELizabeth Simon, Neethu <[email protected]>
Signed-off-by: Jillela, Emmanuel <[email protected]>
Signed-off-by: Beverly Klemme <[email protected]>
Signed-off-by: Elizabeth Simon, Neethu <[email protected]>
Signed-off-by: Patrick Foley <[email protected]>

* [Bug: 768] FX CLI: Separate create, cert gen commands (securefederatedai#807)

This change separates existing command
"fx collaborator.py generate-cert-request" command into two
commands.
"fx collaborator create -n {NAME} -d {DATA_PATH: optional}".
"fx collaborator generate-cert-request -n {NAME}".

Fixes securefederatedai#768

Signed-off-by: Emmanuel Jillela <[email protected]>
Co-authored-by: Emmanuel Jillela <[email protected]>
Signed-off-by: Patrick Foley <[email protected]>

* Add new tutorial example to OpenFL interactive API (securefederatedai#812)

* Add new tutorial example to OpenFL interactive API

This adds a new tutorial example on distributing a linear regression task over OpenFL cluster

The model is defined by scikit-learn which is able to run over both cpu (by default) and gpu. The dataset is 1-dimensional noisy data of sinusoid with pre-defined parameters.

Fixes securefederatedai#798

Co-authored-by: Beverly Klemme <[email protected]>
Co-authored-by: Grant Baker <[email protected]>

Signed-off-by: Yi CAO <[email protected]>

* reduced requirements.txt in workspace

Signed-off-by: Beverly Klemme <[email protected]>

---------

Signed-off-by: Yi CAO <[email protected]>
Signed-off-by: Beverly Klemme <[email protected]>
Co-authored-by: Yi CAO <[email protected]>
Signed-off-by: Patrick Foley <[email protected]>

* build(deps): bump tensorflow in /openfl-workspace/tf_cnn_histology (securefederatedai#776)

Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](tensorflow/tensorflow@v2.9.3...v2.11.1)

---
updated-dependencies:
- dependency-name: tensorflow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Signed-off-by: Patrick Foley <[email protected]>

* build(deps): bump tensorflow (securefederatedai#777)

Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](tensorflow/tensorflow@v2.9.3...v2.11.1)

---
updated-dependencies:
- dependency-name: tensorflow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Signed-off-by: Patrick Foley <[email protected]>

* Update GaNDLF repo location and test CI with master branch

Signed-off-by: Patrick Foley <[email protected]>

* Update GaNDLF repo location and test CI with master branch

Signed-off-by: Patrick Foley <[email protected]>

* Update GaNDLF repo location and test CI with master branch

Signed-off-by: Patrick Foley <[email protected]>

* Fix documentation links. Change path names and templates for CI

Signed-off-by: Patrick Foley <[email protected]>

* Fix paths

Signed-off-by: Patrick Foley <[email protected]>

* Fix paths

Signed-off-by: Patrick Foley <[email protected]>

* Fix breaking tests

Signed-off-by: Patrick Foley <[email protected]>

* Add compatible onnx version to requirements.txt file

Signed-off-by: Patrick Foley <[email protected]>

* Fix wrong csv file name

Signed-off-by: Patrick Foley <[email protected]>

* Fix wrong csv file name

Signed-off-by: Patrick Foley <[email protected]>

* Fix wrong names in workflow file

Signed-off-by: Patrick Foley <[email protected]>

* Fix wrong data path

Signed-off-by: Patrick Foley <[email protected]>

* Fix lint in test_gandlf.py

Signed-off-by: Patrick Foley <[email protected]>

* Fix lint errors

Signed-off-by: Patrick Foley <[email protected]>

---------

Signed-off-by: Patrick Foley <[email protected]>
Signed-off-by: Aleksander Kantak <[email protected]>
Signed-off-by: He, Dan H <[email protected]>
Signed-off-by: Fang, Xiaoran <[email protected]>
Signed-off-by: Klemme, Beverly <[email protected]>
Signed-off-by: Baker, Grant <[email protected]>
Signed-off-by: ELizabeth Simon, Neethu <[email protected]>
Signed-off-by: Jillela, Emmanuel <[email protected]>
Signed-off-by: Beverly Klemme <[email protected]>
Signed-off-by: Elizabeth Simon, Neethu <[email protected]>
Signed-off-by: Emmanuel Jillela <[email protected]>
Signed-off-by: Yi CAO <[email protected]>
Co-authored-by: Sarthak Pati <[email protected]>
Co-authored-by: Prashant Shah <[email protected]>
Co-authored-by: akantak <[email protected]>
Co-authored-by: wangleflex <[email protected]>
Co-authored-by: He, Dan H <[email protected]>
Co-authored-by: xiaoranf <[email protected]>
Co-authored-by: Wang, Wenjie <[email protected]>
Co-authored-by: Lei5 Chen <[email protected]>
Co-authored-by: Beverly Klemme <[email protected]>
Co-authored-by: Emmanuel Jillela <[email protected]>
Co-authored-by: Yi CAO <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid

Signed-off-by: Patrick Foley <[email protected]>

* Fix links in GaNDLF Documentation

* Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid

Signed-off-by: Patrick Foley <[email protected]>

* Fix links in GaNDLF Documentation

Signed-off-by: Patrick Foley <[email protected]>

---------

Signed-off-by: Patrick Foley <[email protected]>
…deratedai#840)

Bumps [onnx](https://github.com/onnx/onnx) from 1.12 to 1.13.0.
- [Release notes](https://github.com/onnx/onnx/releases)
- [Changelog](https://github.com/onnx/onnx/blob/main/docs/Changelog.md)
- [Commits](onnx/onnx@v1.12.0...v1.13.0)

---
updated-dependencies:
- dependency-name: onnx
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Fix incorrectly formatted link in docs

Signed-off-by: Francis Storr <[email protected]>

* Font styling, color contrast, other accessibility updates

This update:
1. Restores Roboto and Lato fonts for most body copy, leaving Intel One Mono for code samples.
2. Adds colors (in `colors.css`)
3. Adds a new `accessibility_overrides.css` file containing CSS that improves the accessibility of the documentation and, where possible, Read The Docs. These updates remediate numerous non-conforming WCAG 2.x Level AA bugs. The use of a separate file for this hopefully makes these changes easier to manage and less likely to be accessibility overwritten in the future.

Closes securefederatedai#848

Signed-off-by: Francis Storr <[email protected]>

---------

Signed-off-by: Francis Storr <[email protected]>
…atest numpy stable release (1.24.3) (securefederatedai#833)

* fixing FedAvg averaging in order to be compatible with numpy v1.24+

Signed-off-by: kta-intel <[email protected]>

* uncommenting installations for consistency with other tutorials

Signed-off-by: kta-intel <[email protected]>

* fixing 301_MNIST_Watermarking tutorial FedAvg

Signed-off-by: kta-intel <[email protected]>

* fixing 301_MNIST_Watermarki
ng tutorial FedAvg

Signed-off-by: kta-intel <[email protected]>

* Switching to py38 kernel and clearing cell outputs

Signed-off-by: kta-intel <[email protected]>

---------

Signed-off-by: kta-intel <[email protected]>
…e/keras_nlp (securefederatedai#773)

* build(deps): bump tensorflow in /openfl-workspace/keras_nlp

Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](tensorflow/tensorflow@v2.8.4...v2.11.1)

---
updated-dependencies:
- dependency-name: tensorflow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>

Signed-off-by: Patrick Foley <[email protected]>

* Update RMSProp optimizer import

Signed-off-by: Patrick Foley <[email protected]>

* flake8

Signed-off-by: Patrick Foley <[email protected]>

---------

Signed-off-by: Patrick Foley <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <[email protected]>
…e/keras_cnn_mnist (securefederatedai#771)

* build(deps): bump tensorflow in /openfl-workspace/keras_cnn_mnist

Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](tensorflow/tensorflow@v2.8.4...v2.11.1)

---
updated-dependencies:
- dependency-name: tensorflow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>

* revert experimental Adam to legacy (securefederatedai#863)

Signed-off-by: kta-intel <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: kta-intel <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Kevin Ta <[email protected]>
…e/keras_cnn_with_compression (securefederatedai#770)

* build(deps): bump tensorflow

Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](tensorflow/tensorflow@v2.8.4...v2.11.1)

---
updated-dependencies:
- dependency-name: tensorflow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>

Signed-off-by: Patrick Foley <[email protected]>

* Update Adam Optimizer import

Signed-off-by: Patrick Foley <[email protected]>

---------

Signed-off-by: Patrick Foley <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <[email protected]>
…s/interactive_api/Flax_CNN_CIFAR (securefederatedai#775)

* build(deps): bump tensorflow

Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](tensorflow/tensorflow@v2.9.3...v2.11.1)

---
updated-dependencies:
- dependency-name: tensorflow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>

* Fixed breaking backages

Signed-off-by: Patrick Foley <[email protected]>

* Add quiet flag back to pip install

Signed-off-by: Patrick Foley <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: Patrick Foley <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <[email protected]>
…space/keras_nlp_gramine_ready (securefederatedai#769)

* build(deps): bump tensorflow-cpu

Bumps [tensorflow-cpu](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](tensorflow/tensorflow@v2.8.4...v2.11.1)

---
updated-dependencies:
- dependency-name: tensorflow-cpu
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>

* Use legacy RMSprop optimizer

Signed-off-by: Patrick Foley <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: Patrick Foley <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <[email protected]>
* Fix incorrectly formatted link in docs

Signed-off-by: Francis Storr <[email protected]>

* Font styling, color contrast, other accessibility updates

This update:
1. Restores Roboto and Lato fonts for most body copy, leaving Intel One Mono for code samples.
2. Adds colors (in `colors.css`)
3. Adds a new `accessibility_overrides.css` file containing CSS that improves the accessibility of the documentation and, where possible, Read The Docs. These updates remediate numerous non-conforming WCAG 2.x Level AA bugs. The use of a separate file for this hopefully makes these changes easier to manage and less likely to be accessibility overwritten in the future.

Closes securefederatedai#848

Signed-off-by: Francis Storr <[email protected]>

* Color contrast updates for accessibility

Color contrast updates for accessibility
- update generic `a` element
- update color of links in the toggle-able read-the-docs panel
- update the color of the text in search results
- update the color of notes headers

Signed-off-by: Francis Storr <[email protected]>

---------

Signed-off-by: Francis Storr <[email protected]>
…refederatedai#758)

* implemented ray.wait

* reverted changes back after testing

* adding datastore cli test case

* removed unused variables

* removed stderr validation

* fixed lint suggestions
…teractive_api_director/experiments/tensorflow_mnist/envoy (securefederatedai#772)

* build(deps): bump tensorflow

Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](tensorflow/tensorflow@v2.8.4...v2.11.1)

---
updated-dependencies:
- dependency-name: tensorflow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>

* Update sd_requirements.txt

* revert to legacy SGD and install tensorflow==2.11 for workflow

Signed-off-by: kta-intel <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: kta-intel <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <[email protected]>
Co-authored-by: kta-intel <[email protected]>
porteratzo and others added 29 commits October 30, 2023 07:43
* Merged 102 and 201

Signed-off-by: leofracca <[email protected]>

* Merge 301-401

Signed-off-by: leofracca <[email protected]>

* Fixed bugs and substituted the example file with the correct one

Signed-off-by: leofracca <[email protected]>

* Fixed cells explanation for Workflow Interface 401

Signed-off-by: leofracca <[email protected]>

* Cleared outputs

Signed-off-by: leofracca <[email protected]>

* Optimized introduction and fixed a wrong class name

Signed-off-by: leofracca <[email protected]>

* Fixed comments

Signed-off-by: leofracca <[email protected]>

* Fixed comments punctuation

Signed-off-by: leofracca <[email protected]>

* Removed unnecessary files and added authors' names

Signed-off-by: leofracca <[email protected]>

* Removed author list

Signed-off-by: leofracca <[email protected]>

---------

Signed-off-by: leofracca <[email protected]>
Co-authored-by: Albio-uni <[email protected]>
Co-authored-by: Rickybolo99 <[email protected]>
Co-authored-by: leofracca <[email protected]>
Co-authored-by: Gabriele <[email protected]>
Co-authored-by: Marcello De Vincenzi <[email protected]>
* Update README.md

Added Gaudi2 run instructions on Intel Developer Cloud

Signed-off-by: orionsBeltWest <[email protected]>

* Update README.md with Gaudi2 instructions

Signed-off-by: orionsBeltWest <[email protected]>

* Update README.md with Gaudi2 instructions

Signed-off-by: orionsBeltWest <[email protected]>

* update README as per PR comments

* Updated README with more information on building a Dockerfile

* Update openfl-tutorials/interactive_api/HPU/PyTorch_MedMNIST_2D/README.md

Co-authored-by: Patrick Foley <[email protected]>

* Update openfl-tutorials/interactive_api/HPU/PyTorch_TinyImageNet/README.md

Co-authored-by: Patrick Foley <[email protected]>

* Update openfl-tutorials/interactive_api/HPU/PyTorch_Kvasir_UNet/README.md

Co-authored-by: Patrick Foley <[email protected]>

---------

Signed-off-by: orionsBeltWest <[email protected]>
Co-authored-by: Patrick Foley <[email protected]>
@porteratzo porteratzo closed this Nov 29, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.