revert experimental Adam optimizer call to legacy [dependabot PR #771] #863
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Signed-off-by: kta-intel <kevin.ta@intel.com>
kta-intel
force-pushed
the
dependabot/pip/openfl-workspace/keras_cnn_mnist/tensorflow-2.11.1
branch
from
0b3f373
to
eb6860b
Compare
kta-intel
changed the title
kta-intel
changed the title
psfoley
merged commit 0912fcf
into
securefederatedai:dependabot/pip/openfl-workspace/keras_cnn_mnist/tensorflow-2.11.1
1 check passed
psfoley
pushed a commit
that referenced
this pull request
Jul 14, 2023
…e/keras_cnn_mnist (#771) * build(deps): bump tensorflow in /openfl-workspace/keras_cnn_mnist Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](tensorflow/tensorflow@v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * revert experimental Adam to legacy (#863) Signed-off-by: kta-intel <kevin.ta@intel.com> --------- Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: kta-intel <kevin.ta@intel.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com>
ParthMandaliya
pushed a commit
to ParthMandaliya/openfl
that referenced
this pull request
Sep 28, 2023
…e/keras_cnn_mnist (securefederatedai#771) * build(deps): bump tensorflow in /openfl-workspace/keras_cnn_mnist Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](tensorflow/tensorflow@v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * revert experimental Adam to legacy (securefederatedai#863) Signed-off-by: kta-intel <kevin.ta@intel.com> --------- Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: kta-intel <kevin.ta@intel.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
ParthMandaliya
pushed a commit
to ParthMandaliya/openfl
that referenced
this pull request
Sep 28, 2023
…e/keras_cnn_mnist (securefederatedai#771) * build(deps): bump tensorflow in /openfl-workspace/keras_cnn_mnist Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](tensorflow/tensorflow@v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * revert experimental Adam to legacy (securefederatedai#863) Signed-off-by: kta-intel <kevin.ta@intel.com> --------- Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: kta-intel <kevin.ta@intel.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
ParthMandaliya
pushed a commit
to ParthMandaliya/openfl
that referenced
this pull request
Sep 28, 2023
…e/keras_cnn_mnist (securefederatedai#771) * build(deps): bump tensorflow in /openfl-workspace/keras_cnn_mnist Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](tensorflow/tensorflow@v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * revert experimental Adam to legacy (securefederatedai#863) Signed-off-by: kta-intel <kevin.ta@intel.com> --------- Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: kta-intel <kevin.ta@intel.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
ParthMandaliya
added a commit
to ParthMandaliya/openfl
that referenced
this pull request
Oct 4, 2023
Squashed commit of the following: commit 5e575c6 Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Fri Sep 29 17:31:52 2023 +0530 Added weighted_average aggregation function under openfl.experimental.interface.{keras,torch}.aggregation_funtions Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit e2e811f Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Thu Sep 28 20:57:48 2023 +0530 Fixed flake8 issues Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit c947e11 Merge: 85e7578 11db127 Author: ParthM-GitHub <parthx.mandaliya@intel.com> Date: Fri Sep 29 00:17:58 2023 +0530 Merge branch 'develop' into workspace-creator commit 11db127 Author: Amit Portnoy <1131991+amitport@users.noreply.github.com> Date: Thu Sep 28 21:34:13 2023 +0300 Update EdenPipeline in the documentation (securefederatedai#877) Signed-off-by: Amit Portnoy <1131991+amitport@users.noreply.github.com> commit 85e7578 Author: Keerti Prakash Talwar <115972088+KeertiX@users.noreply.github.com> Date: Sat Jul 15 01:39:53 2023 +0530 Testflow for verifying stdout redirection to Metaflow datastore (securefederatedai#758) * implemented ray.wait * reverted changes back after testing * adding datastore cli test case * removed unused variables * removed stderr validation * fixed lint suggestions Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 9a51a5d Author: Kevin Ta <116312994+kta-intel@users.noreply.github.com> Date: Fri Jul 14 12:53:08 2023 -0400 fixing FedAvg in workflow interface tutorials to be compatible with latest numpy stable release (1.24.3) (securefederatedai#833) * fixing FedAvg averaging in order to be compatible with numpy v1.24+ Signed-off-by: kta-intel <kevin.ta@intel.com> * uncommenting installations for consistency with other tutorials Signed-off-by: kta-intel <kevin.ta@intel.com> * fixing 301_MNIST_Watermarking tutorial FedAvg Signed-off-by: kta-intel <kevin.ta@intel.com> * fixing 301_MNIST_Watermarki ng tutorial FedAvg Signed-off-by: kta-intel <kevin.ta@intel.com> * Switching to py38 kernel and clearing cell outputs Signed-off-by: kta-intel <kevin.ta@intel.com> --------- Signed-off-by: kta-intel <kevin.ta@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 8c20e73 Author: Francis Storr <francis.storr@intel.com> Date: Fri Jul 14 09:50:49 2023 -0700 Accessibility updates (securefederatedai#861) * Fix incorrectly formatted link in docs Signed-off-by: Francis Storr <francis.storr@intel.com> * Font styling, color contrast, other accessibility updates This update: 1. Restores Roboto and Lato fonts for most body copy, leaving Intel One Mono for code samples. 2. Adds colors (in `colors.css`) 3. Adds a new `accessibility_overrides.css` file containing CSS that improves the accessibility of the documentation and, where possible, Read The Docs. These updates remediate numerous non-conforming WCAG 2.x Level AA bugs. The use of a separate file for this hopefully makes these changes easier to manage and less likely to be accessibility overwritten in the future. Closes securefederatedai#848 Signed-off-by: Francis Storr <francis.storr@intel.com> --------- Signed-off-by: Francis Storr <francis.storr@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 6fb141b Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Thu Sep 28 20:00:46 2023 +0530 Fixed flake8 issues in test/experimental directory Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit cd49915 Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Thu Sep 28 18:24:02 2023 +0530 Fixed flake8 issues Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 99c1d5d Author: Patrick Foley <patrick.foley@intel.com> Date: Thu Sep 21 09:37:50 2023 -0700 Migrate to Ubuntu 22.04 LTS release (supported through 2027) (securefederatedai#875) Signed-off-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit a0368ad Author: Patrick Foley <patrick.foley@intel.com> Date: Thu Sep 14 16:54:11 2023 -0700 Resolve Coverity Issues (securefederatedai#874) * Fix coverity issues * Resolve remaining coverity issues Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 34b704b Author: Mansi Sharma <77758170+mansishr@users.noreply.github.com> Date: Tue Aug 29 15:35:45 2023 -0700 Add FL plan description to documentation (securefederatedai#872) * Add plan description to documentation Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * fix indentation Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * Apply suggestions from code review Co-authored-by: Patrick Foley <patrick.foley@intel.com> --------- Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> Co-authored-by: Patrick Foley <patrick.foley@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 1c7ccc6 Author: Patrick Foley <patrick.foley@intel.com> Date: Fri Aug 25 16:33:55 2023 -0700 Update Tensorflow, gRPC, Protobuf dependencies (securefederatedai#868) * Update Tensorflow to latest, finally update grpcio/protobuf Signed-off-by: Patrick Foley <psfoley@gmail.com> * Lint issue fix and missing tf reference Signed-off-by: Patrick Foley <psfoley@gmail.com> * pyzmq version fixed * fix taskrunner tests for windows Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * fix taskrunner test syntax for windows Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * adding user option to workspace pip install requirements for windows Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * fix windows CI test Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * testing virtual env for windows github actions Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * testing virtual env for windows github actions Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * testing virtual env for windows github actions Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * testing venv for windows Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * test venv for windows * test venv for windows * Added new KerasSerializer. Fixed other Interactive API experiments * Update taskrunner.yml * Update taskrunner.yml * Update workspace.py * Update workspace.py * Update taskrunner.yml * Remove get_model import from global namespace so dependencies are not loaded into memory unnecessarily (breaking windows build) * Refactoring and cleaning up imports to support Windows install * Fixed logger import paths * Fix missing imports * Fix native import * Fix lint errors * Fix keras optimizer patch. Remove irrelevant unit test * Format logs in UTF-8 for windows * Update interactive-kvasir.yml * Consolidate github actions python versions to single file * Update python versions * Update python versions * Update python versions * Reduce # of DataLoader workers for Pytorch Kvasir CI test * Fix Windows encoding * Fix Windows encoding and limit rounds so Github Actions CI doesn't run out of memory Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix windows encoding * Fix Windows encoding --------- Signed-off-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> Co-authored-by: Mansi Sharma <77758170+mansishr@users.noreply.github.com> Co-authored-by: Mansi Sharma <mansi.sharma@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 1b06e60 Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Thu Sep 28 18:00:52 2023 +0530 Added libraries required by WorkspaceBuilder Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit c48c464 Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Thu Sep 28 17:06:13 2023 +0530 Added documentation and inline comments for workspace_builder Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 5ae301d Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Wed Sep 27 15:20:22 2023 +0530 Removed unnecessary files from template_workspace directory Moved print_tree to after generating python script Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 8300e84 Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Tue Sep 26 18:57:49 2023 +0530 Modified workspace_builder/build.py file to resolve a typo Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 83a6567 Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Tue Sep 26 18:53:31 2023 +0530 Modified get_collaborator_args function Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 388cd0e Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Tue Sep 26 18:38:40 2023 +0530 * Created get_collaborator_kwargs function in localruntime class which takes collaborator name as argument and returns name of private attributes function and arguments required to call it. * Changed workspace builder code used get_collaborator_kwargs function to build data.yaml file. Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 38d1015 Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Mon Sep 25 11:29:24 2023 +0530 Removing round number constant argument from 301 MNIST WATERMARKING Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 3c4fd3a Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Fri Sep 22 17:43:01 2023 +0530 Finished exporting data.yaml, plan.yaml. Workspace creator validated for 101 MNIST and 301 Watermarking with MNIST Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit dba24af Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Sat Sep 16 07:03:33 2023 +0530 workspace_creator renamed to workspace_builder finding values without help of any tags Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 20068be Author: Parth Mandaliya <parth.mandaliya.007@gmail.com> Date: Wed Sep 13 10:26:09 2023 +0530 Removed automatically generated Zone.Identifier file Added Approach2 notebook Modified creator.py Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 1f3750a Author: Parth Mandaliya <parth.mandaliya.007@gmail.com> Date: Tue Sep 12 06:09:38 2023 +0530 Modifying arguments help Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 2c7720c Author: Parth Mandaliya <parth.mandaliya.007@gmail.com> Date: Tue Sep 12 06:05:52 2023 +0530 Find aggregator, and collaborator arguments Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 1b4ebfc Author: Parth Mandaliya <parth.mandaliya.007@gmail.com> Date: Tue Sep 12 05:59:02 2023 +0530 Write flow.py, collaborator_private_attrs.py and aggregator_private_attrs.py automatically Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 0a52b4a Author: Parth Mandaliya <parth.mandaliya.007@gmail.com> Date: Tue Sep 12 04:02:35 2023 +0530 Adding functionality to convert jupyter notebook to workspace (in progress) Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit d2ad1a9 Author: ParthM-GitHub <parthx.mandaliya@intel.com> Date: Wed Sep 6 18:50:41 2023 +0530 Update flow.py Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 1c53e30 Author: ParthM-GitHub <parthx.mandaliya@intel.com> Date: Wed Sep 6 18:47:45 2023 +0530 Update flow.py Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 07f283f Author: ParthM-GitHub <parthx.mandaliya@intel.com> Date: Wed Sep 6 13:42:26 2023 +0530 Update data.yaml Correcting a mistake train dataset assigned to test and vice versa. Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 265bf82 Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Thu Aug 31 19:31:25 2023 +0530 This commit brings following changes: 1. Added 501_pytorch_tinyimagenet_transfer_learning workspace for experimental workflow interface 2. Removed `feature_shape` from openfl/experimental/interface/cli/plan.py 3. Resolved flake8 errors in openfl-workspace/experimental directory Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 856fadb Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Wed Aug 30 20:04:56 2023 +0530 This commit brings following updates: 1. Remove unnecessary spaces from Workflow_Interface_102_Aggregator_Validation.ipynb 2. Upgraded protobuf to 3.20.3 in setup.py as per tensorboard requirements 3. Modified 101-torch-cnn-mnist workspace for n-level arguments 4. Added a federated runtime workspace for 102-aggregator-validation Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 4a68b40 Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Tue Aug 29 15:56:58 2023 +0530 Updated logs to provide exact information to user. Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 6a4ce82 Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Mon Aug 28 19:45:06 2023 +0530 Resolving last few TODO items. Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit fb4effa Author: ParthM-GitHub <parthx.mandaliya@intel.com> Date: Mon Aug 28 15:25:35 2023 +0530 Update workflow_interface.rst Added section on how to save best and last model from Metaflow CLI Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 52f0b52 Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Fri Aug 25 18:44:30 2023 +0530 Adding N-level arguments functionality Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 880b7a3 Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Thu Aug 24 17:56:22 2023 +0530 Moving the logs after data.yaml warning, and removing unnecessary blank lines. Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit de2e333 Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Wed Aug 23 17:37:40 2023 +0530 Resolved flake8 issues, Added warning statements when data.yaml is not found or aggregator / collaborator private attributes are not found in data.yaml, Tested by running all tutorials and tests Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit a2ceb05 Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Mon Aug 21 14:42:10 2023 +0530 Fixed flake8 issues and typos Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 36810fe Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Mon Aug 21 13:36:11 2023 +0530 With this commit path of template can be explicitely given, user does not have to choose from available example templates. Only applicable to experimental openfl. Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit baf45f6 Author: ParthM-GitHub <parthx.mandaliya@intel.com> Date: Wed Aug 16 19:01:39 2023 +0530 Updating import statement In 104 keras workspace utils.py updating import SummaryWriter statement from torch to tensorflow Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 0aa070f Author: ParthM-GitHub <parthx.mandaliya@intel.com> Date: Fri Aug 11 20:03:17 2023 +0530 Update resources.py Updated get_number_of_gpus function Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 522a28c Author: ParthM-GitHub <parthx.mandaliya@intel.com> Date: Fri Aug 11 18:37:39 2023 +0530 Update Workflow_Interface_104_Keras_MNIST_with_GPU.ipynb Removing GPU parameter from collaborator decorator. Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 2f4c26e Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Fri Aug 11 14:57:50 2023 +0530 Files added required to test experimental aggregator based workflow by GitHUB actions Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 4545663 Author: ParthM-GitHub <parthx.mandaliya@intel.com> Date: Fri Aug 11 11:24:25 2023 +0530 Update Workflow_Interface_VFL_Two_Party Added actor related changed to Workflow_Interface_VFL_Two_Party Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 5a89b19 Author: ParthM-GitHub <parthx.mandaliya@intel.com> Date: Thu Aug 10 16:01:28 2023 +0530 Update requirements_privacy_meter.txt torch 1.13.1 requires torchvision 0.14.1 not 0.14.0 Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit e5774b1 Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Thu Aug 10 13:37:24 2023 +0530 Added color escape sequences to datastore cli localruntime and workspace testcases Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 02cc8bd Author: ParthM-GitHub <parthx.mandaliya@intel.com> Date: Wed Aug 9 16:41:50 2023 +0530 Update stream_redirect.py Removing unnecessary imports Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 5d9dc60 Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Tue Aug 8 16:32:09 2023 +0530 Removing unnecessary comments Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 6722bf7 Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Tue Aug 8 16:18:57 2023 +0530 Removing unnecessary deepcopies from aggregator.py file Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 9cc04a4 Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Tue Aug 8 16:16:53 2023 +0530 While taking aggregator step remove private attributes before taking checkpoint and set it back to ctx after checkpoint Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 8b64790 Author: porteratzo <44075849+porteratzo@users.noreply.github.com> Date: Fri Aug 4 16:48:04 2023 -0600 pinned tensorboardX (securefederatedai#870) Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 81b9ef0 Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Thu Aug 3 17:54:18 2023 +0530 Added dependecies to each tutorial notebooks Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit bfa3d39 Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Thu Aug 3 14:37:30 2023 +0530 Incoporated review comments Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 07218ce Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Thu Aug 3 13:20:38 2023 +0530 Avoided deep copying the context by removing private attributes from context before checkpoint Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 8a40e91 Author: ParthM-GitHub <parthx.mandaliya@intel.com> Date: Thu Aug 3 10:55:39 2023 +0530 Update collaborator.py Removing unnecessary logs Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit d1bd2ad Author: ParthM-GitHub <parthx.mandaliya@intel.com> Date: Thu Aug 3 10:52:05 2023 +0530 Removing unnecessary logs Removing unnecessary logs Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit a04b8e8 Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Wed Aug 2 18:06:49 2023 +0530 This comming brings following changes: 1. Experimental Aggregator workflow testcases moved to test/github/experimental/workspace directory 2. Added dependecy related changes Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 54be758 Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Wed Aug 2 10:53:25 2023 +0530 Modified 104 Keras MNIST tutorial Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit a7c99da Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Tue Aug 1 14:49:03 2023 +0530 This commit brings following changes: 1. Renamed Workflow_Interface_101_Keras_MNIST_with_GPU.ipynb to Workflow_Interface_104_Keras_MNIST_with_GPU.ipynb 2. Updated documentation in Workflow_Interface_104_Keras_MNIST_with_GPU.ipynb 3. protobuf bumped from 3.19.6 to 3.20.0 in setup.py 4. Incorporating review comments (WIP) Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit edd2f55 Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Date: Thu Jul 27 13:55:52 2023 -0700 build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/tf_2dunet (securefederatedai#774) * build(deps): bump tensorflow in /openfl-workspace/tf_2dunet Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](tensorflow/tensorflow@v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * Update requirements.txt to retrigger CI * Update requirements.txt --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 32c7f34 Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Date: Tue Jul 25 14:48:35 2023 -0700 build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /tests/github/interactive_api_director/experiments/tensorflow_mnist/envoy (securefederatedai#772) * build(deps): bump tensorflow Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](tensorflow/tensorflow@v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * Update sd_requirements.txt * revert to legacy SGD and install tensorflow==2.11 for workflow Signed-off-by: kta-intel <kevin.ta@intel.com> --------- Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: kta-intel <kevin.ta@intel.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Patrick Foley <patrick.foley@intel.com> Co-authored-by: kta-intel <kevin.ta@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 292cb2e Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Sat Jul 29 12:03:14 2023 +0530 This commit brings following changes: 1. Removed torch dependency from "get_number_of_gpus" 2. Added keras mnist example notebook 3. Added keras mnist workspace example 4. Removed openfl-workspace/experimental/experimental-requirements.txt 5. "fx aggregator start" command will install libraries from experimental tutorials requirements_workflow_interface.txt file 6. Added testcase_datastore_cli, testcase_reference and testcase_reference_with_include_exclude 7. Updated 101 torch mnist plan.yaml and data.yaml 8. Removed aggregator start flow thread from cli/aggregator.py 9. At last changes made in federated runtime Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 4d7d995 Author: ParthM-GitHub <parthx.mandaliya@intel.com> Date: Mon Jul 24 11:28:39 2023 +0530 Modified get_number_of_gpus function Modify get_number_of_gpus function Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit cd7955f Author: ParthM-GitHub <parthx.mandaliya@intel.com> Date: Fri Jul 21 18:01:14 2023 +0530 Update resources.py Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 69232cf Author: ParthM-GitHub <parthx.mandaliya@intel.com> Date: Fri Jul 21 04:18:53 2023 +0530 Update 101 tutorial data.yaml Updated 101 tutorials data.yaml to correct a mistake by in index parameter of private attribute function. Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 023a573 Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Fri Jul 21 03:45:27 2023 +0530 Excluding 'experimental' directory from workspace templates Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 618d947 Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Fri Jul 21 03:18:15 2023 +0530 Modified 101, 102, 103, 301, 401 tutorials as per Aggregator, & Collaborator stateful collaborators Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 0deaac7 Author: ParthM-GitHub <parthx.mandaliya@intel.com> Date: Fri Jul 21 02:53:49 2023 +0530 Updating 201 GPUs tutorial Updated Workflow_Interface_201_Exclusive_GPUs_with_Ray.ipynb for Aggregator, and Collaborator as stateful actor Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 6eda625 Author: ParthM-GitHub <parthx.mandaliya@intel.com> Date: Fri Jul 21 02:35:59 2023 +0530 Update requirements_workflow_interface.txt Updated experimental tutorials requirements.txt file Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 6c7ca1d Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Fri Jul 21 02:20:49 2023 +0530 Delete openfl/experimental/utilities/utils.py, and removed torch depency from openfl/experimental/utilities/resources.py Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit e87dbcf Author: ParthM-GitHub <parthx.mandaliya@intel.com> Date: Thu Jul 20 14:27:12 2023 +0530 Update requirements_workflow_interface.txt Metaflow, and Ray dependencies are moved to openfl-workspace/experimental/experimental-requrirements.txt file. Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 911a734 Author: ParthM-GitHub <parthx.mandaliya@intel.com> Date: Thu Jul 20 14:12:19 2023 +0530 Update experimental-requirements.txt Added ray 2.2.0 to experimental-requirements.txt file Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit defe192 Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Thu Jul 20 14:04:12 2023 +0530 Install experimental requirements while activating experimental openfl commands. Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 1154962 Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Thu Jul 20 13:45:00 2023 +0530 While activating experimental OpenFL commands, install depedencies as well. Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 3609303 Author: ParthM-GitHub <parthx.mandaliya@intel.com> Date: Wed Jul 19 21:26:53 2023 +0530 FQDN switched to localhost FQDN switched to localhost Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 04e5297 Author: ParthM-GitHub <parthx.mandaliya@intel.com> Date: Wed Jul 19 19:36:56 2023 +0530 Update aggregator.py Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit b1b641e Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Wed Jul 19 17:07:10 2023 +0530 Modifying temp.sh for 2 collaborators. Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 1839223 Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Wed Jul 19 16:39:06 2023 +0530 plan.yaml modified in 301 watermarking, and subset of collaborators. Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 7b5d2fd Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Wed Jul 19 16:04:44 2023 +0530 Added following tutorials, and testcase: 1. Vertical FL 2. Vertical FL Two Party 3. Internal Loop Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 778294c Author: ParthM-GitHub <parthx.mandaliya@intel.com> Date: Wed Jul 19 14:12:25 2023 +0530 External Loop Functionality Added External Loop Functionality Added Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit b67b725 Author: ParthM-GitHub <parthx.mandaliya@intel.com> Date: Wed Jul 19 14:11:49 2023 +0530 External Loop Functionality Added External Loop Functionality Added Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit cdb8729 Author: ParthM-GitHub <parthx.mandaliya@intel.com> Date: Wed Jul 19 14:10:49 2023 +0530 External Loop Functionality Added External Loop Functionality Added Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit f5bdb07 Author: Francis Storr <francis.storr@intel.com> Date: Fri Jul 14 14:49:03 2023 -0700 Tweak link color so it’s not so aggressive (securefederatedai#865) Signed-off-by: Francis Storr <francis.storr@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit b2bc10a Author: Keerti Prakash Talwar <115972088+KeertiX@users.noreply.github.com> Date: Sat Jul 15 01:39:53 2023 +0530 Testflow for verifying stdout redirection to Metaflow datastore (securefederatedai#758) * implemented ray.wait * reverted changes back after testing * adding datastore cli test case * removed unused variables * removed stderr validation * fixed lint suggestions Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 7666bfe Author: Francis Storr <francis.storr@intel.com> Date: Fri Jul 14 13:09:03 2023 -0700 Accessibility color contrast fixes (securefederatedai#864) * Fix incorrectly formatted link in docs Signed-off-by: Francis Storr <francis.storr@intel.com> * Font styling, color contrast, other accessibility updates This update: 1. Restores Roboto and Lato fonts for most body copy, leaving Intel One Mono for code samples. 2. Adds colors (in `colors.css`) 3. Adds a new `accessibility_overrides.css` file containing CSS that improves the accessibility of the documentation and, where possible, Read The Docs. These updates remediate numerous non-conforming WCAG 2.x Level AA bugs. The use of a separate file for this hopefully makes these changes easier to manage and less likely to be accessibility overwritten in the future. Closes securefederatedai#848 Signed-off-by: Francis Storr <francis.storr@intel.com> * Color contrast updates for accessibility Color contrast updates for accessibility - update generic `a` element - update color of links in the toggle-able read-the-docs panel - update the color of the text in search results - update the color of notes headers Signed-off-by: Francis Storr <francis.storr@intel.com> --------- Signed-off-by: Francis Storr <francis.storr@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 7308c1e Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Date: Fri Jul 14 12:03:04 2023 -0700 build(deps): bump tensorflow-cpu from 2.8.4 to 2.11.1 in /openfl-workspace/keras_nlp_gramine_ready (securefederatedai#769) * build(deps): bump tensorflow-cpu Bumps [tensorflow-cpu](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](tensorflow/tensorflow@v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow-cpu dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * Use legacy RMSprop optimizer Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 3313f6e Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Date: Fri Jul 14 11:52:42 2023 -0700 build(deps): bump tensorflow from 2.9.3 to 2.11.1 in /openfl-tutorials/interactive_api/Flax_CNN_CIFAR (securefederatedai#775) * build(deps): bump tensorflow Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](tensorflow/tensorflow@v2.9.3...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * Fixed breaking backages Signed-off-by: Patrick Foley <psfoley@gmail.com> * Add quiet flag back to pip install Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit fea6684 Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Date: Fri Jul 14 10:53:59 2023 -0700 build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_cnn_with_compression (securefederatedai#770) * build(deps): bump tensorflow Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](tensorflow/tensorflow@v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update Adam Optimizer import Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: Patrick Foley <psfoley@gmail.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit d6d896e Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Date: Fri Jul 14 10:49:08 2023 -0700 build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_cnn_mnist (securefederatedai#771) * build(deps): bump tensorflow in /openfl-workspace/keras_cnn_mnist Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](tensorflow/tensorflow@v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * revert experimental Adam to legacy (securefederatedai#863) Signed-off-by: kta-intel <kevin.ta@intel.com> --------- Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: kta-intel <kevin.ta@intel.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit ee05dfb Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Date: Fri Jul 14 10:48:30 2023 -0700 build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_nlp (securefederatedai#773) * build(deps): bump tensorflow in /openfl-workspace/keras_nlp Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](tensorflow/tensorflow@v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update RMSProp optimizer import Signed-off-by: Patrick Foley <psfoley@gmail.com> * flake8 Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: Patrick Foley <psfoley@gmail.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit f45fa04 Author: Francis Storr <francis.storr@intel.com> Date: Fri Jul 14 09:50:49 2023 -0700 Accessibility updates (securefederatedai#861) * Fix incorrectly formatted link in docs Signed-off-by: Francis Storr <francis.storr@intel.com> * Font styling, color contrast, other accessibility updates This update: 1. Restores Roboto and Lato fonts for most body copy, leaving Intel One Mono for code samples. 2. Adds colors (in `colors.css`) 3. Adds a new `accessibility_overrides.css` file containing CSS that improves the accessibility of the documentation and, where possible, Read The Docs. These updates remediate numerous non-conforming WCAG 2.x Level AA bugs. The use of a separate file for this hopefully makes these changes easier to manage and less likely to be accessibility overwritten in the future. Closes securefederatedai#848 Signed-off-by: Francis Storr <francis.storr@intel.com> --------- Signed-off-by: Francis Storr <francis.storr@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 966840b Author: ParthM-GitHub <parthx.mandaliya@intel.com> Date: Mon Jul 17 20:32:32 2023 +0530 Add files via upload Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> commit 2ada448 Author: Parth Mandaliya <parthx.mandaliya@intel.com> Date: Mon Jul 17 13:30:35 2023 +0530 Modified subset of collaborators testcase. Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
ParthMandaliya
pushed a commit
to ParthMandaliya/openfl
that referenced
this pull request
Oct 4, 2023
…e/keras_cnn_mnist (securefederatedai#771) * build(deps): bump tensorflow in /openfl-workspace/keras_cnn_mnist Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](tensorflow/tensorflow@v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * revert experimental Adam to legacy (securefederatedai#863) Signed-off-by: kta-intel <kevin.ta@intel.com> --------- Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: kta-intel <kevin.ta@intel.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
ParthMandaliya
pushed a commit
to ParthMandaliya/openfl
that referenced
this pull request
Oct 5, 2023
…e/keras_cnn_mnist (securefederatedai#771) * build(deps): bump tensorflow in /openfl-workspace/keras_cnn_mnist Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](tensorflow/tensorflow@v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * revert experimental Adam to legacy (securefederatedai#863) Signed-off-by: kta-intel <kevin.ta@intel.com> --------- Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: kta-intel <kevin.ta@intel.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
ParthMandaliya
pushed a commit
to ParthMandaliya/openfl
that referenced
this pull request
Oct 5, 2023
…e/keras_cnn_mnist (securefederatedai#771) * build(deps): bump tensorflow in /openfl-workspace/keras_cnn_mnist Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](tensorflow/tensorflow@v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * revert experimental Adam to legacy (securefederatedai#863) Signed-off-by: kta-intel <kevin.ta@intel.com> --------- Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: kta-intel <kevin.ta@intel.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
psfoley
pushed a commit
to psfoley/openfl
that referenced
this pull request
Oct 18, 2023
…e/keras_cnn_mnist (securefederatedai#771) * build(deps): bump tensorflow in /openfl-workspace/keras_cnn_mnist Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](tensorflow/tensorflow@v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * revert experimental Adam to legacy (securefederatedai#863) Signed-off-by: kta-intel <kevin.ta@intel.com> --------- Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: kta-intel <kevin.ta@intel.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com>
psfoley
added a commit
that referenced
this pull request
Feb 15, 2024
* Fix flake8 error in local runtime (#764)
* Removes unnecessary dict comprehension
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Removes unnecessary dict comprehension
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update ROADMAP.md (#765)
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update README.md
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update GOVERNANCE.md
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update ROADMAP.md (#785)
Typos
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated integrations to GaNDLF (#781)
* renaming loader and runner
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
* updated plan to pick the new names
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
* new key name
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
* allow the ability to pass a file to `gandlf_config_dict` in addition to fully-fledged parameters
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
* checking this differently
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
* rename variable for clarity
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
---------
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update README.md
Removed references to Intel's ownship, given it's now owned by the LF AI and Data.
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fix Flake8 C419 for Ubuntu CI (#800)
C419 Unnecessary list comprehension passed to any()/all() prevents short-circuiting - rewrite as a generator
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Introduced shard descriptor based collaborator private attributes
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Adding batch size for train, and test in config.yaml file
Files modified:
1. config.yaml
2. mnist_shard_descriptor.py
3. Workflow_Interface_101_MNIST.ipynb
4. participants.py
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Introducing multiple config yaml files
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removing unnecessary config.yaml file.
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added collaborator private atribute delayed initialization
for local_runtime
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Incorporated review comments
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added multi-pricessing ray backend support and, aggregator yaml file
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated multi-processing code
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* RayExecutor class moved from participants.py to localruntime.py
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* RayExecytor moved from interface/pariticipants.py to
runtime/local_runtime.py
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added Aggregator private attribute initialation in runtime
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removed unnecessary import statements
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Code cleaned up, validated checkpoints manually
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Refactored, and added some new doc string
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolved Flake8 instructions
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Recusrsion removal + Serialization removal integrated
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Incoporated Review Comments
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removed configuration YAML files, and
added functionality to initialize private attributes by calling a
callback function created by end-user
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removed commented code
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Implemented new approach, two example files given
1. Workflow_Interface_101_MNIST.py
2. Workflow_Interface_301_MNIST_Watermarking.py
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Internal Review Comments Incorporated
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* No private attributes are required
If private attributes are not provided, by default take an empty dictionary no need to pass a callable function.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update participants.py
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added a check for GPU Resource Allocation
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified error message for resource allocation
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolved bug found during testing phase
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modifide all the test cases, and following tutorials
1. Privacy Meter
2. FedProx
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added following test cases:
1. Workflow_Interface_101_MNIST.ipynb
2. Workflow_Interface_102_Aggregator_Validation.ipynb
3. Workflow_Interface_301_MNIST_Watermarking.ipynb
4. Workflow_Interface_201_Exclusive_GPUs_with_Ray.ipynb
5. Workflow_Interface_103_Cyclic_Institutional_Incremental_Learning.ipynb
Signed-off-by: Parth Mandaliya <Parthx.Mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified and Added Global_DP tutorials.
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified and Added tutorial Workflow-Interface_201_Exclusive_GPUs_with_Ray.ipynb
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified documentation for Workflow_Interface_201 tutorial.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* fixed flake-8 errors
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* reverted import module code
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolved merge conflicts in local_runtime.py
---------
Fix flake8 error in local runtime (#764)
* Removes unnecessary dict comprehension
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Removes unnecessary dict comprehension
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update README.md
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fix warnings and issues in docs (#825)
* Fix warnings and issues in docs
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
* fixup! Fix warnings and issues in docs
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
---------
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Add Logo (#827)
* Add Logo
* Update README.md
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Change OpenFL documentation font to improve accessibility (#809)
This replaces the font of OpenFL documents with Intel One Mono font for low vision developers.
Known issues:
1. The text font within the images has not been changed.
2. Some icons that do not exist in the new font cannot be displayed properly.
Fixes securefederatedai#799
Co-authored-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Co-authored-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update unit tests to improve code coverage (#821)
* Update ci config
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add unit test for following files
- openfl/federated/plan/plan.py
- openfl/interface/aggregation_functions/core/adaptive_aggregation.py
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add some test cases for databases module
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Fix bugs for databases module unittest
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Update unit tests for component module
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Restore workflow config and update some comments
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Enable save_ test case.
Add yaml under test dir for unit test usage.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove plan to new dir.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove plan to new dir.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add aggregator start test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 2 aggregator test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 1 aggregator test case.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Format code.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Refactor code.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add collaborator start test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 1 collaborator test case.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Format with flake8
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove TODO comments
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
---------
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com>
Co-authored-by: Lei5 Chen <lei5.chen@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Add PyTorch linear regression example (#808)
This adds a new tutorial example on distributing a linear regression task over OpenFL cluster.
The model is defined by Pytorch which is able to run over both cpu (by default) and gpu. The dataset is generated by make_regression from sklearn.datasets with pre-defined parameters.
Fixes #797
Co-authored-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* This prints out the hash of the CSR to disk for both the aggregator and (#813)
* This prints out the hash of the CSR to disk for both the aggregator and
collaborator. The user then compares and approves this hash with the
hash printed out of the file to validate the CSR. In addition, a warning
message is pritned if certify is run in silent mode.
Fixes securefederatedai#692
Signed-off-by: Grant Baker <grant.baker@intel.com>
* Refactor read_csr function to use get_csr_hash
Signed-off-by: Grant Baker <grant.baker@intel.com>
* Ask to check hashes before prompt
---------
Signed-off-by: Grant Baker <grant.baker@intel.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Improve workspace requirements import (#810)
Remove the dump_requirement_file operation in export_ method.
Fixes securefederatedai#767
Co-authored-by: Li, Qingqing <qingqing.li@intel.com>
Co-authored-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Issue 506 Added Example using FedProx (#818)
* created new ineractive_api dir to hold pytorch fedprox mnist example
corrected files
changed to FedProxOptimizer and ran set_old_weights for new FedProx Pytorch example
renamed FedProx notebook
used mode.parrameters() to get pytorch model weights
got weights using state_dict
changed old wieghts to list (for serialization) and fixed README
input wieghts before zero_grad
[Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api
This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.
Fixes: #506
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api
This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.
Fixes: securefederatedai#506
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* Update README.md
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* addressed comments by psfoley: corrected words in the jupyter notebook metadata and added a link to the FedProx paper in the README.
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
---------
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* [Bug: 768] FX CLI: Separate create, cert gen commands (#807)
This change separates existing command
"fx collaborator.py generate-cert-request" command into two
commands.
"fx collaborator create -n {NAME} -d {DATA_PATH: optional}".
"fx collaborator generate-cert-request -n {NAME}".
Fixes #768
Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Add new tutorial example to OpenFL interactive API (#812)
* Add new tutorial example to OpenFL interactive API
This adds a new tutorial example on distributing a linear regression task over OpenFL cluster
The model is defined by scikit-learn which is able to run over both cpu (by default) and gpu. The dataset is 1-dimensional noisy data of sinusoid with pre-defined parameters.
Fixes #798
Co-authored-by: Beverly Klemme <beverly.klemme@intel.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Yi CAO <yi2.cao@intel.com>
* reduced requirements.txt in workspace
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
---------
Signed-off-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Co-authored-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow in /openfl-workspace/tf_cnn_histology (#776)
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow (#777)
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Running a federation with GaNDLF Documentation (#794)
* Initial commit of Running the federation with GaNDLF Documentation
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update README.md
Removed references to Intel's ownship, given it's now owned by the LF AI and Data.
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix Flake8 C419 for Ubuntu CI (#800)
C419 Unnecessary list comprehension passed to any()/all() prevents short-circuiting - rewrite as a generator
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update README.md
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix warnings and issues in docs (#825)
* Fix warnings and issues in docs
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
* fixup! Fix warnings and issues in docs
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
---------
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add Logo (#827)
* Add Logo
* Update README.md
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Change OpenFL documentation font to improve accessibility (#809)
This replaces the font of OpenFL documents with Intel One Mono font for low vision developers.
Known issues:
1. The text font within the images has not been changed.
2. Some icons that do not exist in the new font cannot be displayed properly.
Fixes securefederatedai#799
Co-authored-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Co-authored-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update unit tests to improve code coverage (#821)
* Update ci config
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add unit test for following files
- openfl/federated/plan/plan.py
- openfl/interface/aggregation_functions/core/adaptive_aggregation.py
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add some test cases for databases module
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Fix bugs for databases module unittest
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Update unit tests for component module
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Restore workflow config and update some comments
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Enable save_ test case.
Add yaml under test dir for unit test usage.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove plan to new dir.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove plan to new dir.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add aggregator start test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 2 aggregator test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 1 aggregator test case.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Format code.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Refactor code.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add collaborator start test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 1 collaborator test case.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Format with flake8
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove TODO comments
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
---------
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com>
Co-authored-by: Lei5 Chen <lei5.chen@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add PyTorch linear regression example (#808)
This adds a new tutorial example on distributing a linear regression task over OpenFL cluster.
The model is defined by Pytorch which is able to run over both cpu (by default) and gpu. The dataset is generated by make_regression from sklearn.datasets with pre-defined parameters.
Fixes #797
Co-authored-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* This prints out the hash of the CSR to disk for both the aggregator and (#813)
* This prints out the hash of the CSR to disk for both the aggregator and
collaborator. The user then compares and approves this hash with the
hash printed out of the file to validate the CSR. In addition, a warning
message is pritned if certify is run in silent mode.
Fixes securefederatedai#692
Signed-off-by: Grant Baker <grant.baker@intel.com>
* Refactor read_csr function to use get_csr_hash
Signed-off-by: Grant Baker <grant.baker@intel.com>
* Ask to check hashes before prompt
---------
Signed-off-by: Grant Baker <grant.baker@intel.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Improve workspace requirements import (#810)
Remove the dump_requirement_file operation in export_ method.
Fixes securefederatedai#767
Co-authored-by: Li, Qingqing <qingqing.li@intel.com>
Co-authored-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Issue 506 Added Example using FedProx (#818)
* created new ineractive_api dir to hold pytorch fedprox mnist example
corrected files
changed to FedProxOptimizer and ran set_old_weights for new FedProx Pytorch example
renamed FedProx notebook
used mode.parrameters() to get pytorch model weights
got weights using state_dict
changed old wieghts to list (for serialization) and fixed README
input wieghts before zero_grad
[Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api
This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.
Fixes: #506
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api
This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.
Fixes: securefederatedai#506
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* Update README.md
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* addressed comments by psfoley: corrected words in the jupyter notebook metadata and added a link to the FedProx paper in the README.
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
---------
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* [Bug: 768] FX CLI: Separate create, cert gen commands (#807)
This change separates existing command
"fx collaborator.py generate-cert-request" command into two
commands.
"fx collaborator create -n {NAME} -d {DATA_PATH: optional}".
"fx collaborator generate-cert-request -n {NAME}".
Fixes #768
Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add new tutorial example to OpenFL interactive API (#812)
* Add new tutorial example to OpenFL interactive API
This adds a new tutorial example on distributing a linear regression task over OpenFL cluster
The model is defined by scikit-learn which is able to run over both cpu (by default) and gpu. The dataset is 1-dimensional noisy data of sinusoid with pre-defined parameters.
Fixes #798
Co-authored-by: Beverly Klemme <beverly.klemme@intel.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Yi CAO <yi2.cao@intel.com>
* reduced requirements.txt in workspace
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
---------
Signed-off-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Co-authored-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* build(deps): bump tensorflow in /openfl-workspace/tf_cnn_histology (#776)
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* build(deps): bump tensorflow (#777)
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update GaNDLF repo location and test CI with master branch
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update GaNDLF repo location and test CI with master branch
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update GaNDLF repo location and test CI with master branch
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix documentation links. Change path names and templates for CI
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix paths
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix paths
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix breaking tests
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add compatible onnx version to requirements.txt file
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix wrong csv file name
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix wrong csv file name
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix wrong names in workflow file
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix wrong data path
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix lint in test_gandlf.py
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix lint errors
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Signed-off-by: Yi CAO <yi2.cao@intel.com>
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Co-authored-by: Prashant Shah <40899779+SprashAI@users.noreply.github.com>
Co-authored-by: akantak <aleksander.kantak@intel.com>
Co-authored-by: wangleflex <106506636+wangleflex@users.noreply.github.com>
Co-authored-by: He, Dan H <dan.h.he@intel.com>
Co-authored-by: xiaoranf <desolatefang@gmail.com>
Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com>
Co-authored-by: Lei5 Chen <lei5.chen@intel.com>
Co-authored-by: Beverly Klemme <35578090+bjklemme-intel@users.noreply.github.com>
Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Co-authored-by: Yi CAO <yi2.cao@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid (#841)
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fix GaNDLF documentation links (#842)
* Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix links in GaNDLF Documentation
* Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix links in GaNDLF Documentation
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fix incorrectly formatted link in docs (#839)
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolving merge conflicts in local-runtime.py
Integrated aggregator as stateful actor branch, tested.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
--------
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump onnx in /openfl-workspace/gandlf_seg_test (#840)
Bumps [onnx](https://github.com/onnx/onnx) from 1.12 to 1.13.0.
- [Release notes](https://github.com/onnx/onnx/releases)
- [Changelog](https://github.com/onnx/onnx/blob/main/docs/Changelog.md)
- [Commits](https://github.com/onnx/onnx/compare/v1.12.0...v1.13.0)
---
updated-dependencies:
- dependency-name: onnx
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Merged changes of remove-torch-dependency branch
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update setup.py
Upgrading protobuf to 3.20.3 as per tensorboard requirement
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolving merge conflicts
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Accessibility updates (#861)
* Fix incorrectly formatted link in docs
Signed-off-by: Francis Storr <francis.storr@intel.com>
* Font styling, color contrast, other accessibility updates
This update:
1. Restores Roboto and Lato fonts for most body copy, leaving Intel One Mono for code samples.
2. Adds colors (in `colors.css`)
3. Adds a new `accessibility_overrides.css` file containing CSS that improves the accessibility of the documentation and, where possible, Read The Docs. These updates remediate numerous non-conforming WCAG 2.x Level AA bugs. The use of a separate file for this hopefully makes these changes easier to manage and less likely to be accessibility overwritten in the future.
Closes #848
Signed-off-by: Francis Storr <francis.storr@intel.com>
---------
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_nlp (#773)
* build(deps): bump tensorflow in /openfl-workspace/keras_nlp
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update RMSProp optimizer import
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* flake8
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_cnn_mnist (#771)
* build(deps): bump tensorflow in /openfl-workspace/keras_cnn_mnist
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* revert experimental Adam to legacy (#863)
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: kta-intel <kevin.ta@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_cnn_with_compression (#770)
* build(deps): bump tensorflow
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update Adam Optimizer import
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.9.3 to 2.11.1 in /openfl-tutorials/interactive_api/Flax_CNN_CIFAR (#775)
* build(deps): bump tensorflow
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* Fixed breaking backages
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add quiet flag back to pip install
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow-cpu from 2.8.4 to 2.11.1 in /openfl-workspace/keras_nlp_gramine_ready (#769)
* build(deps): bump tensorflow-cpu
Bumps [tensorflow-cpu](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow-cpu
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* Use legacy RMSprop optimizer
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Accessibility color contrast fixes (#864)
* Fix incorrectly formatted link in docs
Signed-off-by: Francis Storr <francis.storr@intel.com>
* Font styling, color contrast, other accessibility updates
This update:
1. Restores Roboto and Lato fonts for most body copy, leaving Intel One Mono for code samples.
2. Adds colors (in `colors.css`)
3. Adds a new `accessibility_overrides.css` file containing CSS that improves the accessibility of the documentation and, where possible, Read The Docs. These updates remediate numerous non-conforming WCAG 2.x Level AA bugs. The use of a separate file for this hopefully makes these changes easier to manage and less likely to be accessibility overwritten in the future.
Closes #848
Signed-off-by: Francis Storr <francis.storr@intel.com>
* Color contrast updates for accessibility
Color contrast updates for accessibility
- update generic `a` element
- update color of links in the toggle-able read-the-docs panel
- update the color of the text in search results
- update the color of notes headers
Signed-off-by: Francis Storr <francis.storr@intel.com>
---------
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Tweak link color so it’s not so aggressive (#865)
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /tests/github/interactive_api_director/experiments/tensorflow_mnist/envoy (#772)
* build(deps): bump tensorflow
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* Update sd_requirements.txt
* revert to legacy SGD and install tensorflow==2.11 for workflow
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: kta-intel <kevin.ta@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <patrick.foley@intel.com>
Co-authored-by: kta-intel <kevin.ta@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/tf_2dunet (#774)
* build(deps): bump tensorflow in /openfl-workspace/tf_2dunet
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* Update requirements.txt
to retrigger CI
* Update requirements.txt
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update Tensorflow, gRPC, Protobuf dependencies (#868)
* Update Tensorflow to latest, finally update grpcio/protobuf
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Lint issue fix and missing tf reference
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* pyzmq version fixed
* fix taskrunner tests for windows
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* fix taskrunner test syntax for windows
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* adding user option to workspace pip install requirements for windows
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* fix windows CI test
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* testing virtual env for windows github actions
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* testing virtual env for windows github actions
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* testing virtual env for windows github actions
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* testing venv for windows
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* test venv for windows
* test venv for windows
* Added new KerasSerializer. Fixed other Interactive API experiments
* Update taskrunner.yml
* Update taskrunner.yml
* Update workspace.py
* Update workspace.py
* Update taskrunner.yml
* Remove get_model import from global namespace so dependencies are not loaded into memory unnecessarily (breaking windows build)
* Refactoring and cleaning up imports to support Windows install
* Fixed logger import paths
* Fix missing imports
* Fix native import
* Fix lint errors
* Fix keras optimizer patch. Remove irrelevant unit test
* Format logs in UTF-8 for windows
* Update interactive-kvasir.yml
* Consolidate github actions python versions to single file
* Update python versions
* Update python versions
* Update python versions
* Reduce # of DataLoader workers for Pytorch Kvasir CI test
* Fix Windows encoding
* Fix Windows encoding and limit rounds so Github Actions CI doesn't run out of memory
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix windows encoding
* Fix Windows encoding
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
Co-authored-by: Mansi Sharma <77758170+mansishr@users.noreply.github.com>
Co-authored-by: Mansi Sharma <mansi.sharma@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Add FL plan description to documentation (#872)
* Add plan description to documentation
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* fix indentation
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* Apply suggestions from code review
Co-authored-by: Patrick Foley <patrick.foley@intel.com>
---------
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
Co-authored-by: Patrick Foley <patrick.foley@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolved flake8 issues
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* GPU Added for aggregator
Fixed issue in 103 Cyclic Institutional Incremental Learning tutorial
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolve Coverity Issues (#874)
* Fix coverity issues
* Resolve remaining coverity issues
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Migrate to Ubuntu 22.04 LTS release (supported through 2027) (#875)
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated documentation:
docs/workflow_interface.rst
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated documentation
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update workflow_interface.rst
Fixing typo
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added best model and last model extraction technique in docs/workflow_interface.rst
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added GPU for aggregator
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolving merge conflicts in 103 cyclic tutorial notebook
fixing FedAvg in workflow interface tutorials to be compatible with latest numpy stable release (1.24.3) (#833)
* fixing FedAvg averaging in order to be compatible with numpy v1.24+
Signed-off-by: kta-intel <kevin.ta@intel.com>
* uncommenting installations for consistency with other tutorials
Signed-off-by: kta-intel <kevin.ta@intel.com>
* fixing 301_MNIST_Watermarking tutorial FedAvg
Signed-off-by: kta-intel <kevin.ta@intel.com>
* fixing 301_MNIST_Watermarki
ng tutorial FedAvg
Signed-off-by: kta-intel <kevin.ta@intel.com>
* Switching to py38 kernel and clearing cell outputs
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolved merge conflicts in tests/github/experimental/testflow_datastore_cli.py
Testflow for verifying stdout redirection to Metaflow datastore (#758)
* implemented ray.wait
* reverted changes back after testing
* adding datastore cli test case
* removed unused variables
* removed stderr validation
* fixed lint suggestions
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added weighted_average aggregation function under openfl.experimental.interface.{keras,torch}.aggregation_funtions
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update EdenPipeline in the documentation (#877)
Signed-off-by: Amit Portnoy <1131991+amitport@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* WIP: CI Scans (#873)
* Initial scans commit for bandit, hadolint, trivy
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Address bandit scan results
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix Trivy action
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix linting
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add Coverity Badge
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update Hadolint threshold to flag errors only
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update Hadolint threshold to flag errors only
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update ROADMAP.md (#878)
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* initial commit
* add docstrings
* change importlib to import
* remove unnecesary files, replace ray with ray_grouped
* remove max concurency, add number of actors
* Trigger CI
* run tests
* lint changes
* flake
* changed number of actors to num_actors, added docs
* Fixed workflow API tests
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* lint fixes
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <Parthx.Mandaliya@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
Signed-off-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Signed-off-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: kta-intel <kevin.ta@intel.com>
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
Signed-off-by: Amit Portnoy <1131991+amitport@users.noreply.github.com>
Co-authored-by: Patrick Foley <patrick.foley@intel.com>
Co-authored-by: Olga Perepelkina <olga.perepelkina@intel.com>
Co-authored-by: Joe Devon <138038+joedevon@users.noreply.github.com>
Co-authored-by: Sarthak Pati <sarthak.pati@hotmail.com>
Co-authored-by: Prashant Shah <40899779+SprashAI@users.noreply.github.com>
Co-authored-by: akantak <aleksander.kantak@intel.com>
Co-authored-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Co-authored-by: Parth Mandaliya <Parthx@Mandaliya.intel.com>
Co-authored-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Co-authored-by: Keerti Talwar <keertix.talwar@intel.com>
Co-authored-by: KeertiX <keertix.talwarx@intel.com>
Co-authored-by: wangleflex <106506636+wangleflex@users.noreply.github.com>
Co-authored-by: He, Dan H <dan.h.he@intel.com>
Co-authored-by: xiaoranf <desolatefang@gmail.com>
Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com>
Co-authored-by: Lei5 Chen <lei5.chen@intel.com>
Co-authored-by: Beverly Klemme <35578090+bjklemme-intel@users.noreply.github.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Co-authored-by: Yi CAO <yi2.cao@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Co-authored-by: Francis Storr <francis.storr@intel.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com>
Co-authored-by: kta-intel <kevin.ta@intel.com>
Co-authored-by: Mansi Sharma <77758170+mansishr@users.noreply.github.com>
Co-authored-by: Mansi Sharma <mansi.sharma@intel.com>
Co-authored-by: Sachin Gupta <sachin.gupta.dsp@gmail.com>
Co-authored-by: Keerti Prakash Talwar <115972088+KeertiX@users.noreply.github.com>
Co-authored-by: Amit Portnoy <1131991+amitport@users.noreply.github.com>
nammbash
pushed a commit
to nammbash/openfl
that referenced
this pull request
Feb 27, 2024
* Fix flake8 error in local runtime (#764)
* Removes unnecessary dict comprehension
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Removes unnecessary dict comprehension
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update ROADMAP.md (#765)
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update README.md
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update GOVERNANCE.md
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update ROADMAP.md (#785)
Typos
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated integrations to GaNDLF (#781)
* renaming loader and runner
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
* updated plan to pick the new names
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
* new key name
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
* allow the ability to pass a file to `gandlf_config_dict` in addition to fully-fledged parameters
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
* checking this differently
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
* rename variable for clarity
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
---------
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update README.md
Removed references to Intel's ownship, given it's now owned by the LF AI and Data.
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fix Flake8 C419 for Ubuntu CI (#800)
C419 Unnecessary list comprehension passed to any()/all() prevents short-circuiting - rewrite as a generator
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Introduced shard descriptor based collaborator private attributes
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Adding batch size for train, and test in config.yaml file
Files modified:
1. config.yaml
2. mnist_shard_descriptor.py
3. Workflow_Interface_101_MNIST.ipynb
4. participants.py
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Introducing multiple config yaml files
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removing unnecessary config.yaml file.
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added collaborator private atribute delayed initialization
for local_runtime
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Incorporated review comments
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added multi-pricessing ray backend support and, aggregator yaml file
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated multi-processing code
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* RayExecutor class moved from participants.py to localruntime.py
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* RayExecytor moved from interface/pariticipants.py to
runtime/local_runtime.py
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added Aggregator private attribute initialation in runtime
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removed unnecessary import statements
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Code cleaned up, validated checkpoints manually
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Refactored, and added some new doc string
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolved Flake8 instructions
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Recusrsion removal + Serialization removal integrated
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Incoporated Review Comments
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removed configuration YAML files, and
added functionality to initialize private attributes by calling a
callback function created by end-user
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removed commented code
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Implemented new approach, two example files given
1. Workflow_Interface_101_MNIST.py
2. Workflow_Interface_301_MNIST_Watermarking.py
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Internal Review Comments Incorporated
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* No private attributes are required
If private attributes are not provided, by default take an empty dictionary no need to pass a callable function.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update participants.py
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added a check for GPU Resource Allocation
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified error message for resource allocation
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolved bug found during testing phase
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modifide all the test cases, and following tutorials
1. Privacy Meter
2. FedProx
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added following test cases:
1. Workflow_Interface_101_MNIST.ipynb
2. Workflow_Interface_102_Aggregator_Validation.ipynb
3. Workflow_Interface_301_MNIST_Watermarking.ipynb
4. Workflow_Interface_201_Exclusive_GPUs_with_Ray.ipynb
5. Workflow_Interface_103_Cyclic_Institutional_Incremental_Learning.ipynb
Signed-off-by: Parth Mandaliya <Parthx.Mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified and Added Global_DP tutorials.
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified and Added tutorial Workflow-Interface_201_Exclusive_GPUs_with_Ray.ipynb
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified documentation for Workflow_Interface_201 tutorial.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* fixed flake-8 errors
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* reverted import module code
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolved merge conflicts in local_runtime.py
---------
Fix flake8 error in local runtime (#764)
* Removes unnecessary dict comprehension
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Removes unnecessary dict comprehension
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update README.md
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fix warnings and issues in docs (#825)
* Fix warnings and issues in docs
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
* fixup! Fix warnings and issues in docs
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
---------
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Add Logo (#827)
* Add Logo
* Update README.md
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Change OpenFL documentation font to improve accessibility (#809)
This replaces the font of OpenFL documents with Intel One Mono font for low vision developers.
Known issues:
1. The text font within the images has not been changed.
2. Some icons that do not exist in the new font cannot be displayed properly.
Fixes securefederatedai#799
Co-authored-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Co-authored-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update unit tests to improve code coverage (#821)
* Update ci config
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add unit test for following files
- openfl/federated/plan/plan.py
- openfl/interface/aggregation_functions/core/adaptive_aggregation.py
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add some test cases for databases module
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Fix bugs for databases module unittest
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Update unit tests for component module
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Restore workflow config and update some comments
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Enable save_ test case.
Add yaml under test dir for unit test usage.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove plan to new dir.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove plan to new dir.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add aggregator start test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 2 aggregator test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 1 aggregator test case.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Format code.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Refactor code.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add collaborator start test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 1 collaborator test case.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Format with flake8
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove TODO comments
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
---------
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com>
Co-authored-by: Lei5 Chen <lei5.chen@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Add PyTorch linear regression example (#808)
This adds a new tutorial example on distributing a linear regression task over OpenFL cluster.
The model is defined by Pytorch which is able to run over both cpu (by default) and gpu. The dataset is generated by make_regression from sklearn.datasets with pre-defined parameters.
Fixes #797
Co-authored-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* This prints out the hash of the CSR to disk for both the aggregator and (#813)
* This prints out the hash of the CSR to disk for both the aggregator and
collaborator. The user then compares and approves this hash with the
hash printed out of the file to validate the CSR. In addition, a warning
message is pritned if certify is run in silent mode.
Fixes securefederatedai#692
Signed-off-by: Grant Baker <grant.baker@intel.com>
* Refactor read_csr function to use get_csr_hash
Signed-off-by: Grant Baker <grant.baker@intel.com>
* Ask to check hashes before prompt
---------
Signed-off-by: Grant Baker <grant.baker@intel.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Improve workspace requirements import (#810)
Remove the dump_requirement_file operation in export_ method.
Fixes securefederatedai#767
Co-authored-by: Li, Qingqing <qingqing.li@intel.com>
Co-authored-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Issue 506 Added Example using FedProx (#818)
* created new ineractive_api dir to hold pytorch fedprox mnist example
corrected files
changed to FedProxOptimizer and ran set_old_weights for new FedProx Pytorch example
renamed FedProx notebook
used mode.parrameters() to get pytorch model weights
got weights using state_dict
changed old wieghts to list (for serialization) and fixed README
input wieghts before zero_grad
[Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api
This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.
Fixes: #506
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api
This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.
Fixes: securefederatedai#506
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* Update README.md
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* addressed comments by psfoley: corrected words in the jupyter notebook metadata and added a link to the FedProx paper in the README.
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
---------
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* [Bug: 768] FX CLI: Separate create, cert gen commands (#807)
This change separates existing command
"fx collaborator.py generate-cert-request" command into two
commands.
"fx collaborator create -n {NAME} -d {DATA_PATH: optional}".
"fx collaborator generate-cert-request -n {NAME}".
Fixes #768
Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Add new tutorial example to OpenFL interactive API (#812)
* Add new tutorial example to OpenFL interactive API
This adds a new tutorial example on distributing a linear regression task over OpenFL cluster
The model is defined by scikit-learn which is able to run over both cpu (by default) and gpu. The dataset is 1-dimensional noisy data of sinusoid with pre-defined parameters.
Fixes #798
Co-authored-by: Beverly Klemme <beverly.klemme@intel.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Yi CAO <yi2.cao@intel.com>
* reduced requirements.txt in workspace
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
---------
Signed-off-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Co-authored-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow in /openfl-workspace/tf_cnn_histology (#776)
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow (#777)
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Running a federation with GaNDLF Documentation (#794)
* Initial commit of Running the federation with GaNDLF Documentation
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update README.md
Removed references to Intel's ownship, given it's now owned by the LF AI and Data.
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix Flake8 C419 for Ubuntu CI (#800)
C419 Unnecessary list comprehension passed to any()/all() prevents short-circuiting - rewrite as a generator
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update README.md
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix warnings and issues in docs (#825)
* Fix warnings and issues in docs
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
* fixup! Fix warnings and issues in docs
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
---------
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add Logo (#827)
* Add Logo
* Update README.md
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Change OpenFL documentation font to improve accessibility (#809)
This replaces the font of OpenFL documents with Intel One Mono font for low vision developers.
Known issues:
1. The text font within the images has not been changed.
2. Some icons that do not exist in the new font cannot be displayed properly.
Fixes securefederatedai#799
Co-authored-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Co-authored-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update unit tests to improve code coverage (#821)
* Update ci config
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add unit test for following files
- openfl/federated/plan/plan.py
- openfl/interface/aggregation_functions/core/adaptive_aggregation.py
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add some test cases for databases module
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Fix bugs for databases module unittest
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Update unit tests for component module
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Restore workflow config and update some comments
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Enable save_ test case.
Add yaml under test dir for unit test usage.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove plan to new dir.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove plan to new dir.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add aggregator start test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 2 aggregator test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 1 aggregator test case.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Format code.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Refactor code.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add collaborator start test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 1 collaborator test case.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Format with flake8
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove TODO comments
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
---------
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com>
Co-authored-by: Lei5 Chen <lei5.chen@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add PyTorch linear regression example (#808)
This adds a new tutorial example on distributing a linear regression task over OpenFL cluster.
The model is defined by Pytorch which is able to run over both cpu (by default) and gpu. The dataset is generated by make_regression from sklearn.datasets with pre-defined parameters.
Fixes #797
Co-authored-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* This prints out the hash of the CSR to disk for both the aggregator and (#813)
* This prints out the hash of the CSR to disk for both the aggregator and
collaborator. The user then compares and approves this hash with the
hash printed out of the file to validate the CSR. In addition, a warning
message is pritned if certify is run in silent mode.
Fixes securefederatedai#692
Signed-off-by: Grant Baker <grant.baker@intel.com>
* Refactor read_csr function to use get_csr_hash
Signed-off-by: Grant Baker <grant.baker@intel.com>
* Ask to check hashes before prompt
---------
Signed-off-by: Grant Baker <grant.baker@intel.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Improve workspace requirements import (#810)
Remove the dump_requirement_file operation in export_ method.
Fixes securefederatedai#767
Co-authored-by: Li, Qingqing <qingqing.li@intel.com>
Co-authored-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Issue 506 Added Example using FedProx (#818)
* created new ineractive_api dir to hold pytorch fedprox mnist example
corrected files
changed to FedProxOptimizer and ran set_old_weights for new FedProx Pytorch example
renamed FedProx notebook
used mode.parrameters() to get pytorch model weights
got weights using state_dict
changed old wieghts to list (for serialization) and fixed README
input wieghts before zero_grad
[Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api
This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.
Fixes: #506
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api
This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.
Fixes: securefederatedai#506
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* Update README.md
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* addressed comments by psfoley: corrected words in the jupyter notebook metadata and added a link to the FedProx paper in the README.
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
---------
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* [Bug: 768] FX CLI: Separate create, cert gen commands (#807)
This change separates existing command
"fx collaborator.py generate-cert-request" command into two
commands.
"fx collaborator create -n {NAME} -d {DATA_PATH: optional}".
"fx collaborator generate-cert-request -n {NAME}".
Fixes #768
Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add new tutorial example to OpenFL interactive API (#812)
* Add new tutorial example to OpenFL interactive API
This adds a new tutorial example on distributing a linear regression task over OpenFL cluster
The model is defined by scikit-learn which is able to run over both cpu (by default) and gpu. The dataset is 1-dimensional noisy data of sinusoid with pre-defined parameters.
Fixes #798
Co-authored-by: Beverly Klemme <beverly.klemme@intel.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Yi CAO <yi2.cao@intel.com>
* reduced requirements.txt in workspace
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
---------
Signed-off-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Co-authored-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* build(deps): bump tensorflow in /openfl-workspace/tf_cnn_histology (#776)
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* build(deps): bump tensorflow (#777)
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update GaNDLF repo location and test CI with master branch
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update GaNDLF repo location and test CI with master branch
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update GaNDLF repo location and test CI with master branch
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix documentation links. Change path names and templates for CI
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix paths
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix paths
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix breaking tests
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add compatible onnx version to requirements.txt file
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix wrong csv file name
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix wrong csv file name
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix wrong names in workflow file
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix wrong data path
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix lint in test_gandlf.py
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix lint errors
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Signed-off-by: Yi CAO <yi2.cao@intel.com>
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Co-authored-by: Prashant Shah <40899779+SprashAI@users.noreply.github.com>
Co-authored-by: akantak <aleksander.kantak@intel.com>
Co-authored-by: wangleflex <106506636+wangleflex@users.noreply.github.com>
Co-authored-by: He, Dan H <dan.h.he@intel.com>
Co-authored-by: xiaoranf <desolatefang@gmail.com>
Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com>
Co-authored-by: Lei5 Chen <lei5.chen@intel.com>
Co-authored-by: Beverly Klemme <35578090+bjklemme-intel@users.noreply.github.com>
Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Co-authored-by: Yi CAO <yi2.cao@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid (#841)
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fix GaNDLF documentation links (#842)
* Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix links in GaNDLF Documentation
* Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix links in GaNDLF Documentation
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fix incorrectly formatted link in docs (#839)
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolving merge conflicts in local-runtime.py
Integrated aggregator as stateful actor branch, tested.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
--------
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump onnx in /openfl-workspace/gandlf_seg_test (#840)
Bumps [onnx](https://github.com/onnx/onnx) from 1.12 to 1.13.0.
- [Release notes](https://github.com/onnx/onnx/releases)
- [Changelog](https://github.com/onnx/onnx/blob/main/docs/Changelog.md)
- [Commits](https://github.com/onnx/onnx/compare/v1.12.0...v1.13.0)
---
updated-dependencies:
- dependency-name: onnx
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Merged changes of remove-torch-dependency branch
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update setup.py
Upgrading protobuf to 3.20.3 as per tensorboard requirement
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolving merge conflicts
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Accessibility updates (#861)
* Fix incorrectly formatted link in docs
Signed-off-by: Francis Storr <francis.storr@intel.com>
* Font styling, color contrast, other accessibility updates
This update:
1. Restores Roboto and Lato fonts for most body copy, leaving Intel One Mono for code samples.
2. Adds colors (in `colors.css`)
3. Adds a new `accessibility_overrides.css` file containing CSS that improves the accessibility of the documentation and, where possible, Read The Docs. These updates remediate numerous non-conforming WCAG 2.x Level AA bugs. The use of a separate file for this hopefully makes these changes easier to manage and less likely to be accessibility overwritten in the future.
Closes #848
Signed-off-by: Francis Storr <francis.storr@intel.com>
---------
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_nlp (#773)
* build(deps): bump tensorflow in /openfl-workspace/keras_nlp
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update RMSProp optimizer import
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* flake8
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_cnn_mnist (#771)
* build(deps): bump tensorflow in /openfl-workspace/keras_cnn_mnist
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* revert experimental Adam to legacy (#863)
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: kta-intel <kevin.ta@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_cnn_with_compression (#770)
* build(deps): bump tensorflow
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update Adam Optimizer import
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.9.3 to 2.11.1 in /openfl-tutorials/interactive_api/Flax_CNN_CIFAR (#775)
* build(deps): bump tensorflow
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* Fixed breaking backages
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add quiet flag back to pip install
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow-cpu from 2.8.4 to 2.11.1 in /openfl-workspace/keras_nlp_gramine_ready (#769)
* build(deps): bump tensorflow-cpu
Bumps [tensorflow-cpu](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow-cpu
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* Use legacy RMSprop optimizer
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Accessibility color contrast fixes (#864)
* Fix incorrectly formatted link in docs
Signed-off-by: Francis Storr <francis.storr@intel.com>
* Font styling, color contrast, other accessibility updates
This update:
1. Restores Roboto and Lato fonts for most body copy, leaving Intel One Mono for code samples.
2. Adds colors (in `colors.css`)
3. Adds a new `accessibility_overrides.css` file containing CSS that improves the accessibility of the documentation and, where possible, Read The Docs. These updates remediate numerous non-conforming WCAG 2.x Level AA bugs. The use of a separate file for this hopefully makes these changes easier to manage and less likely to be accessibility overwritten in the future.
Closes #848
Signed-off-by: Francis Storr <francis.storr@intel.com>
* Color contrast updates for accessibility
Color contrast updates for accessibility
- update generic `a` element
- update color of links in the toggle-able read-the-docs panel
- update the color of the text in search results
- update the color of notes headers
Signed-off-by: Francis Storr <francis.storr@intel.com>
---------
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Tweak link color so it’s not so aggressive (#865)
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /tests/github/interactive_api_director/experiments/tensorflow_mnist/envoy (#772)
* build(deps): bump tensorflow
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* Update sd_requirements.txt
* revert to legacy SGD and install tensorflow==2.11 for workflow
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: kta-intel <kevin.ta@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <patrick.foley@intel.com>
Co-authored-by: kta-intel <kevin.ta@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/tf_2dunet (#774)
* build(deps): bump tensorflow in /openfl-workspace/tf_2dunet
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* Update requirements.txt
to retrigger CI
* Update requirements.txt
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update Tensorflow, gRPC, Protobuf dependencies (#868)
* Update Tensorflow to latest, finally update grpcio/protobuf
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Lint issue fix and missing tf reference
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* pyzmq version fixed
* fix taskrunner tests for windows
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* fix taskrunner test syntax for windows
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* adding user option to workspace pip install requirements for windows
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* fix windows CI test
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* testing virtual env for windows github actions
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* testing virtual env for windows github actions
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* testing virtual env for windows github actions
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* testing venv for windows
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* test venv for windows
* test venv for windows
* Added new KerasSerializer. Fixed other Interactive API experiments
* Update taskrunner.yml
* Update taskrunner.yml
* Update workspace.py
* Update workspace.py
* Update taskrunner.yml
* Remove get_model import from global namespace so dependencies are not loaded into memory unnecessarily (breaking windows build)
* Refactoring and cleaning up imports to support Windows install
* Fixed logger import paths
* Fix missing imports
* Fix native import
* Fix lint errors
* Fix keras optimizer patch. Remove irrelevant unit test
* Format logs in UTF-8 for windows
* Update interactive-kvasir.yml
* Consolidate github actions python versions to single file
* Update python versions
* Update python versions
* Update python versions
* Reduce # of DataLoader workers for Pytorch Kvasir CI test
* Fix Windows encoding
* Fix Windows encoding and limit rounds so Github Actions CI doesn't run out of memory
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix windows encoding
* Fix Windows encoding
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
Co-authored-by: Mansi Sharma <77758170+mansishr@users.noreply.github.com>
Co-authored-by: Mansi Sharma <mansi.sharma@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Add FL plan description to documentation (#872)
* Add plan description to documentation
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* fix indentation
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* Apply suggestions from code review
Co-authored-by: Patrick Foley <patrick.foley@intel.com>
---------
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
Co-authored-by: Patrick Foley <patrick.foley@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolved flake8 issues
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* GPU Added for aggregator
Fixed issue in 103 Cyclic Institutional Incremental Learning tutorial
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolve Coverity Issues (#874)
* Fix coverity issues
* Resolve remaining coverity issues
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Migrate to Ubuntu 22.04 LTS release (supported through 2027) (#875)
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated documentation:
docs/workflow_interface.rst
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated documentation
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update workflow_interface.rst
Fixing typo
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added best model and last model extraction technique in docs/workflow_interface.rst
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added GPU for aggregator
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolving merge conflicts in 103 cyclic tutorial notebook
fixing FedAvg in workflow interface tutorials to be compatible with latest numpy stable release (1.24.3) (#833)
* fixing FedAvg averaging in order to be compatible with numpy v1.24+
Signed-off-by: kta-intel <kevin.ta@intel.com>
* uncommenting installations for consistency with other tutorials
Signed-off-by: kta-intel <kevin.ta@intel.com>
* fixing 301_MNIST_Watermarking tutorial FedAvg
Signed-off-by: kta-intel <kevin.ta@intel.com>
* fixing 301_MNIST_Watermarki
ng tutorial FedAvg
Signed-off-by: kta-intel <kevin.ta@intel.com>
* Switching to py38 kernel and clearing cell outputs
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolved merge conflicts in tests/github/experimental/testflow_datastore_cli.py
Testflow for verifying stdout redirection to Metaflow datastore (#758)
* implemented ray.wait
* reverted changes back after testing
* adding datastore cli test case
* removed unused variables
* removed stderr validation
* fixed lint suggestions
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added weighted_average aggregation function under openfl.experimental.interface.{keras,torch}.aggregation_funtions
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update EdenPipeline in the documentation (#877)
Signed-off-by: Amit Portnoy <1131991+amitport@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* WIP: CI Scans (#873)
* Initial scans commit for bandit, hadolint, trivy
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Address bandit scan results
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix Trivy action
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix linting
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add Coverity Badge
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update Hadolint threshold to flag errors only
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update Hadolint threshold to flag errors only
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update ROADMAP.md (#878)
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* initial commit
* add docstrings
* change importlib to import
* remove unnecesary files, replace ray with ray_grouped
* remove max concurency, add number of actors
* Trigger CI
* run tests
* lint changes
* flake
* changed number of actors to num_actors, added docs
* Fixed workflow API tests
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* lint fixes
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <Parthx.Mandaliya@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
Signed-off-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Signed-off-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: kta-intel <kevin.ta@intel.com>
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
Signed-off-by: Amit Portnoy <1131991+amitport@users.noreply.github.com>
Co-authored-by: Patrick Foley <patrick.foley@intel.com>
Co-authored-by: Olga Perepelkina <olga.perepelkina@intel.com>
Co-authored-by: Joe Devon <138038+joedevon@users.noreply.github.com>
Co-authored-by: Sarthak Pati <sarthak.pati@hotmail.com>
Co-authored-by: Prashant Shah <40899779+SprashAI@users.noreply.github.com>
Co-authored-by: akantak <aleksander.kantak@intel.com>
Co-authored-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Co-authored-by: Parth Mandaliya <Parthx@Mandaliya.intel.com>
Co-authored-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Co-authored-by: Keerti Talwar <keertix.talwar@intel.com>
Co-authored-by: KeertiX <keertix.talwarx@intel.com>
Co-authored-by: wangleflex <106506636+wangleflex@users.noreply.github.com>
Co-authored-by: He, Dan H <dan.h.he@intel.com>
Co-authored-by: xiaoranf <desolatefang@gmail.com>
Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com>
Co-authored-by: Lei5 Chen <lei5.chen@intel.com>
Co-authored-by: Beverly Klemme <35578090+bjklemme-intel@users.noreply.github.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Co-authored-by: Yi CAO <yi2.cao@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Co-authored-by: Francis Storr <francis.storr@intel.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com>
Co-authored-by: kta-intel <kevin.ta@intel.com>
Co-authored-by: Mansi Sharma <77758170+mansishr@users.noreply.github.com>
Co-authored-by: Mansi Sharma <mansi.sharma@intel.com>
Co-authored-by: Sachin Gupta <sachin.gupta.dsp@gmail.com>
Co-authored-by: Keerti Prakash Talwar <115972088+KeertiX@users.noreply.github.com>
Co-authored-by: Amit Portnoy <1131991+amitport@users.noreply.github.com>
Signed-off-by: nammbash <niroopshankar.ammbashankar@intel.com>
nammbash
pushed a commit
to nammbash/openfl
that referenced
this pull request
Feb 27, 2024
* Fix flake8 error in local runtime (#764)
* Removes unnecessary dict comprehension
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Removes unnecessary dict comprehension
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update ROADMAP.md (#765)
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update README.md
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update GOVERNANCE.md
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update ROADMAP.md (#785)
Typos
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated integrations to GaNDLF (#781)
* renaming loader and runner
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
* updated plan to pick the new names
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
* new key name
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
* allow the ability to pass a file to `gandlf_config_dict` in addition to fully-fledged parameters
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
* checking this differently
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
* rename variable for clarity
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
---------
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update README.md
Removed references to Intel's ownship, given it's now owned by the LF AI and Data.
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fix Flake8 C419 for Ubuntu CI (#800)
C419 Unnecessary list comprehension passed to any()/all() prevents short-circuiting - rewrite as a generator
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Introduced shard descriptor based collaborator private attributes
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Adding batch size for train, and test in config.yaml file
Files modified:
1. config.yaml
2. mnist_shard_descriptor.py
3. Workflow_Interface_101_MNIST.ipynb
4. participants.py
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Introducing multiple config yaml files
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removing unnecessary config.yaml file.
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added collaborator private atribute delayed initialization
for local_runtime
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Incorporated review comments
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added multi-pricessing ray backend support and, aggregator yaml file
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated multi-processing code
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* RayExecutor class moved from participants.py to localruntime.py
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* RayExecytor moved from interface/pariticipants.py to
runtime/local_runtime.py
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added Aggregator private attribute initialation in runtime
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removed unnecessary import statements
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Code cleaned up, validated checkpoints manually
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Refactored, and added some new doc string
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolved Flake8 instructions
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Recusrsion removal + Serialization removal integrated
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Incoporated Review Comments
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removed configuration YAML files, and
added functionality to initialize private attributes by calling a
callback function created by end-user
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removed commented code
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Implemented new approach, two example files given
1. Workflow_Interface_101_MNIST.py
2. Workflow_Interface_301_MNIST_Watermarking.py
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Internal Review Comments Incorporated
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* No private attributes are required
If private attributes are not provided, by default take an empty dictionary no need to pass a callable function.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update participants.py
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added a check for GPU Resource Allocation
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified error message for resource allocation
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolved bug found during testing phase
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modifide all the test cases, and following tutorials
1. Privacy Meter
2. FedProx
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added following test cases:
1. Workflow_Interface_101_MNIST.ipynb
2. Workflow_Interface_102_Aggregator_Validation.ipynb
3. Workflow_Interface_301_MNIST_Watermarking.ipynb
4. Workflow_Interface_201_Exclusive_GPUs_with_Ray.ipynb
5. Workflow_Interface_103_Cyclic_Institutional_Incremental_Learning.ipynb
Signed-off-by: Parth Mandaliya <Parthx.Mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified and Added Global_DP tutorials.
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified and Added tutorial Workflow-Interface_201_Exclusive_GPUs_with_Ray.ipynb
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified documentation for Workflow_Interface_201 tutorial.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* fixed flake-8 errors
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* reverted import module code
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolved merge conflicts in local_runtime.py
---------
Fix flake8 error in local runtime (#764)
* Removes unnecessary dict comprehension
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Removes unnecessary dict comprehension
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update README.md
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fix warnings and issues in docs (#825)
* Fix warnings and issues in docs
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
* fixup! Fix warnings and issues in docs
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
---------
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Add Logo (#827)
* Add Logo
* Update README.md
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Change OpenFL documentation font to improve accessibility (#809)
This replaces the font of OpenFL documents with Intel One Mono font for low vision developers.
Known issues:
1. The text font within the images has not been changed.
2. Some icons that do not exist in the new font cannot be displayed properly.
Fixes securefederatedai#799
Co-authored-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Co-authored-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update unit tests to improve code coverage (#821)
* Update ci config
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add unit test for following files
- openfl/federated/plan/plan.py
- openfl/interface/aggregation_functions/core/adaptive_aggregation.py
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add some test cases for databases module
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Fix bugs for databases module unittest
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Update unit tests for component module
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Restore workflow config and update some comments
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Enable save_ test case.
Add yaml under test dir for unit test usage.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove plan to new dir.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove plan to new dir.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add aggregator start test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 2 aggregator test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 1 aggregator test case.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Format code.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Refactor code.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add collaborator start test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 1 collaborator test case.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Format with flake8
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove TODO comments
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
---------
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com>
Co-authored-by: Lei5 Chen <lei5.chen@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Add PyTorch linear regression example (#808)
This adds a new tutorial example on distributing a linear regression task over OpenFL cluster.
The model is defined by Pytorch which is able to run over both cpu (by default) and gpu. The dataset is generated by make_regression from sklearn.datasets with pre-defined parameters.
Fixes #797
Co-authored-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* This prints out the hash of the CSR to disk for both the aggregator and (#813)
* This prints out the hash of the CSR to disk for both the aggregator and
collaborator. The user then compares and approves this hash with the
hash printed out of the file to validate the CSR. In addition, a warning
message is pritned if certify is run in silent mode.
Fixes securefederatedai#692
Signed-off-by: Grant Baker <grant.baker@intel.com>
* Refactor read_csr function to use get_csr_hash
Signed-off-by: Grant Baker <grant.baker@intel.com>
* Ask to check hashes before prompt
---------
Signed-off-by: Grant Baker <grant.baker@intel.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Improve workspace requirements import (#810)
Remove the dump_requirement_file operation in export_ method.
Fixes securefederatedai#767
Co-authored-by: Li, Qingqing <qingqing.li@intel.com>
Co-authored-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Issue 506 Added Example using FedProx (#818)
* created new ineractive_api dir to hold pytorch fedprox mnist example
corrected files
changed to FedProxOptimizer and ran set_old_weights for new FedProx Pytorch example
renamed FedProx notebook
used mode.parrameters() to get pytorch model weights
got weights using state_dict
changed old wieghts to list (for serialization) and fixed README
input wieghts before zero_grad
[Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api
This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.
Fixes: #506
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api
This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.
Fixes: securefederatedai#506
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* Update README.md
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* addressed comments by psfoley: corrected words in the jupyter notebook metadata and added a link to the FedProx paper in the README.
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
---------
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* [Bug: 768] FX CLI: Separate create, cert gen commands (#807)
This change separates existing command
"fx collaborator.py generate-cert-request" command into two
commands.
"fx collaborator create -n {NAME} -d {DATA_PATH: optional}".
"fx collaborator generate-cert-request -n {NAME}".
Fixes #768
Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Add new tutorial example to OpenFL interactive API (#812)
* Add new tutorial example to OpenFL interactive API
This adds a new tutorial example on distributing a linear regression task over OpenFL cluster
The model is defined by scikit-learn which is able to run over both cpu (by default) and gpu. The dataset is 1-dimensional noisy data of sinusoid with pre-defined parameters.
Fixes #798
Co-authored-by: Beverly Klemme <beverly.klemme@intel.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Yi CAO <yi2.cao@intel.com>
* reduced requirements.txt in workspace
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
---------
Signed-off-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Co-authored-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow in /openfl-workspace/tf_cnn_histology (#776)
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow (#777)
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Running a federation with GaNDLF Documentation (#794)
* Initial commit of Running the federation with GaNDLF Documentation
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update README.md
Removed references to Intel's ownship, given it's now owned by the LF AI and Data.
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix Flake8 C419 for Ubuntu CI (#800)
C419 Unnecessary list comprehension passed to any()/all() prevents short-circuiting - rewrite as a generator
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update README.md
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix warnings and issues in docs (#825)
* Fix warnings and issues in docs
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
* fixup! Fix warnings and issues in docs
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
---------
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add Logo (#827)
* Add Logo
* Update README.md
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Change OpenFL documentation font to improve accessibility (#809)
This replaces the font of OpenFL documents with Intel One Mono font for low vision developers.
Known issues:
1. The text font within the images has not been changed.
2. Some icons that do not exist in the new font cannot be displayed properly.
Fixes securefederatedai#799
Co-authored-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Co-authored-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update unit tests to improve code coverage (#821)
* Update ci config
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add unit test for following files
- openfl/federated/plan/plan.py
- openfl/interface/aggregation_functions/core/adaptive_aggregation.py
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add some test cases for databases module
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Fix bugs for databases module unittest
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Update unit tests for component module
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Restore workflow config and update some comments
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Enable save_ test case.
Add yaml under test dir for unit test usage.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove plan to new dir.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove plan to new dir.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add aggregator start test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 2 aggregator test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 1 aggregator test case.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Format code.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Refactor code.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add collaborator start test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 1 collaborator test case.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Format with flake8
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove TODO comments
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
---------
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com>
Co-authored-by: Lei5 Chen <lei5.chen@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add PyTorch linear regression example (#808)
This adds a new tutorial example on distributing a linear regression task over OpenFL cluster.
The model is defined by Pytorch which is able to run over both cpu (by default) and gpu. The dataset is generated by make_regression from sklearn.datasets with pre-defined parameters.
Fixes #797
Co-authored-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* This prints out the hash of the CSR to disk for both the aggregator and (#813)
* This prints out the hash of the CSR to disk for both the aggregator and
collaborator. The user then compares and approves this hash with the
hash printed out of the file to validate the CSR. In addition, a warning
message is pritned if certify is run in silent mode.
Fixes securefederatedai#692
Signed-off-by: Grant Baker <grant.baker@intel.com>
* Refactor read_csr function to use get_csr_hash
Signed-off-by: Grant Baker <grant.baker@intel.com>
* Ask to check hashes before prompt
---------
Signed-off-by: Grant Baker <grant.baker@intel.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Improve workspace requirements import (#810)
Remove the dump_requirement_file operation in export_ method.
Fixes securefederatedai#767
Co-authored-by: Li, Qingqing <qingqing.li@intel.com>
Co-authored-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Issue 506 Added Example using FedProx (#818)
* created new ineractive_api dir to hold pytorch fedprox mnist example
corrected files
changed to FedProxOptimizer and ran set_old_weights for new FedProx Pytorch example
renamed FedProx notebook
used mode.parrameters() to get pytorch model weights
got weights using state_dict
changed old wieghts to list (for serialization) and fixed README
input wieghts before zero_grad
[Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api
This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.
Fixes: #506
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api
This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.
Fixes: securefederatedai#506
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* Update README.md
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* addressed comments by psfoley: corrected words in the jupyter notebook metadata and added a link to the FedProx paper in the README.
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
---------
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* [Bug: 768] FX CLI: Separate create, cert gen commands (#807)
This change separates existing command
"fx collaborator.py generate-cert-request" command into two
commands.
"fx collaborator create -n {NAME} -d {DATA_PATH: optional}".
"fx collaborator generate-cert-request -n {NAME}".
Fixes #768
Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add new tutorial example to OpenFL interactive API (#812)
* Add new tutorial example to OpenFL interactive API
This adds a new tutorial example on distributing a linear regression task over OpenFL cluster
The model is defined by scikit-learn which is able to run over both cpu (by default) and gpu. The dataset is 1-dimensional noisy data of sinusoid with pre-defined parameters.
Fixes #798
Co-authored-by: Beverly Klemme <beverly.klemme@intel.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Yi CAO <yi2.cao@intel.com>
* reduced requirements.txt in workspace
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
---------
Signed-off-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Co-authored-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* build(deps): bump tensorflow in /openfl-workspace/tf_cnn_histology (#776)
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* build(deps): bump tensorflow (#777)
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update GaNDLF repo location and test CI with master branch
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update GaNDLF repo location and test CI with master branch
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update GaNDLF repo location and test CI with master branch
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix documentation links. Change path names and templates for CI
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix paths
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix paths
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix breaking tests
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add compatible onnx version to requirements.txt file
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix wrong csv file name
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix wrong csv file name
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix wrong names in workflow file
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix wrong data path
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix lint in test_gandlf.py
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix lint errors
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Signed-off-by: Yi CAO <yi2.cao@intel.com>
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Co-authored-by: Prashant Shah <40899779+SprashAI@users.noreply.github.com>
Co-authored-by: akantak <aleksander.kantak@intel.com>
Co-authored-by: wangleflex <106506636+wangleflex@users.noreply.github.com>
Co-authored-by: He, Dan H <dan.h.he@intel.com>
Co-authored-by: xiaoranf <desolatefang@gmail.com>
Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com>
Co-authored-by: Lei5 Chen <lei5.chen@intel.com>
Co-authored-by: Beverly Klemme <35578090+bjklemme-intel@users.noreply.github.com>
Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Co-authored-by: Yi CAO <yi2.cao@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid (#841)
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fix GaNDLF documentation links (#842)
* Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix links in GaNDLF Documentation
* Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix links in GaNDLF Documentation
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fix incorrectly formatted link in docs (#839)
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolving merge conflicts in local-runtime.py
Integrated aggregator as stateful actor branch, tested.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
--------
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump onnx in /openfl-workspace/gandlf_seg_test (#840)
Bumps [onnx](https://github.com/onnx/onnx) from 1.12 to 1.13.0.
- [Release notes](https://github.com/onnx/onnx/releases)
- [Changelog](https://github.com/onnx/onnx/blob/main/docs/Changelog.md)
- [Commits](https://github.com/onnx/onnx/compare/v1.12.0...v1.13.0)
---
updated-dependencies:
- dependency-name: onnx
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Merged changes of remove-torch-dependency branch
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update setup.py
Upgrading protobuf to 3.20.3 as per tensorboard requirement
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolving merge conflicts
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Accessibility updates (#861)
* Fix incorrectly formatted link in docs
Signed-off-by: Francis Storr <francis.storr@intel.com>
* Font styling, color contrast, other accessibility updates
This update:
1. Restores Roboto and Lato fonts for most body copy, leaving Intel One Mono for code samples.
2. Adds colors (in `colors.css`)
3. Adds a new `accessibility_overrides.css` file containing CSS that improves the accessibility of the documentation and, where possible, Read The Docs. These updates remediate numerous non-conforming WCAG 2.x Level AA bugs. The use of a separate file for this hopefully makes these changes easier to manage and less likely to be accessibility overwritten in the future.
Closes #848
Signed-off-by: Francis Storr <francis.storr@intel.com>
---------
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_nlp (#773)
* build(deps): bump tensorflow in /openfl-workspace/keras_nlp
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update RMSProp optimizer import
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* flake8
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_cnn_mnist (#771)
* build(deps): bump tensorflow in /openfl-workspace/keras_cnn_mnist
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* revert experimental Adam to legacy (#863)
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: kta-intel <kevin.ta@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_cnn_with_compression (#770)
* build(deps): bump tensorflow
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update Adam Optimizer import
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.9.3 to 2.11.1 in /openfl-tutorials/interactive_api/Flax_CNN_CIFAR (#775)
* build(deps): bump tensorflow
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* Fixed breaking backages
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add quiet flag back to pip install
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow-cpu from 2.8.4 to 2.11.1 in /openfl-workspace/keras_nlp_gramine_ready (#769)
* build(deps): bump tensorflow-cpu
Bumps [tensorflow-cpu](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow-cpu
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* Use legacy RMSprop optimizer
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Accessibility color contrast fixes (#864)
* Fix incorrectly formatted link in docs
Signed-off-by: Francis Storr <francis.storr@intel.com>
* Font styling, color contrast, other accessibility updates
This update:
1. Restores Roboto and Lato fonts for most body copy, leaving Intel One Mono for code samples.
2. Adds colors (in `colors.css`)
3. Adds a new `accessibility_overrides.css` file containing CSS that improves the accessibility of the documentation and, where possible, Read The Docs. These updates remediate numerous non-conforming WCAG 2.x Level AA bugs. The use of a separate file for this hopefully makes these changes easier to manage and less likely to be accessibility overwritten in the future.
Closes #848
Signed-off-by: Francis Storr <francis.storr@intel.com>
* Color contrast updates for accessibility
Color contrast updates for accessibility
- update generic `a` element
- update color of links in the toggle-able read-the-docs panel
- update the color of the text in search results
- update the color of notes headers
Signed-off-by: Francis Storr <francis.storr@intel.com>
---------
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Tweak link color so it’s not so aggressive (#865)
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /tests/github/interactive_api_director/experiments/tensorflow_mnist/envoy (#772)
* build(deps): bump tensorflow
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* Update sd_requirements.txt
* revert to legacy SGD and install tensorflow==2.11 for workflow
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: kta-intel <kevin.ta@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <patrick.foley@intel.com>
Co-authored-by: kta-intel <kevin.ta@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/tf_2dunet (#774)
* build(deps): bump tensorflow in /openfl-workspace/tf_2dunet
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* Update requirements.txt
to retrigger CI
* Update requirements.txt
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update Tensorflow, gRPC, Protobuf dependencies (#868)
* Update Tensorflow to latest, finally update grpcio/protobuf
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Lint issue fix and missing tf reference
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* pyzmq version fixed
* fix taskrunner tests for windows
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* fix taskrunner test syntax for windows
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* adding user option to workspace pip install requirements for windows
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* fix windows CI test
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* testing virtual env for windows github actions
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* testing virtual env for windows github actions
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* testing virtual env for windows github actions
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* testing venv for windows
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* test venv for windows
* test venv for windows
* Added new KerasSerializer. Fixed other Interactive API experiments
* Update taskrunner.yml
* Update taskrunner.yml
* Update workspace.py
* Update workspace.py
* Update taskrunner.yml
* Remove get_model import from global namespace so dependencies are not loaded into memory unnecessarily (breaking windows build)
* Refactoring and cleaning up imports to support Windows install
* Fixed logger import paths
* Fix missing imports
* Fix native import
* Fix lint errors
* Fix keras optimizer patch. Remove irrelevant unit test
* Format logs in UTF-8 for windows
* Update interactive-kvasir.yml
* Consolidate github actions python versions to single file
* Update python versions
* Update python versions
* Update python versions
* Reduce # of DataLoader workers for Pytorch Kvasir CI test
* Fix Windows encoding
* Fix Windows encoding and limit rounds so Github Actions CI doesn't run out of memory
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix windows encoding
* Fix Windows encoding
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
Co-authored-by: Mansi Sharma <77758170+mansishr@users.noreply.github.com>
Co-authored-by: Mansi Sharma <mansi.sharma@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Add FL plan description to documentation (#872)
* Add plan description to documentation
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* fix indentation
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* Apply suggestions from code review
Co-authored-by: Patrick Foley <patrick.foley@intel.com>
---------
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
Co-authored-by: Patrick Foley <patrick.foley@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolved flake8 issues
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* GPU Added for aggregator
Fixed issue in 103 Cyclic Institutional Incremental Learning tutorial
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolve Coverity Issues (#874)
* Fix coverity issues
* Resolve remaining coverity issues
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Migrate to Ubuntu 22.04 LTS release (supported through 2027) (#875)
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated documentation:
docs/workflow_interface.rst
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated documentation
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update workflow_interface.rst
Fixing typo
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added best model and last model extraction technique in docs/workflow_interface.rst
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added GPU for aggregator
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolving merge conflicts in 103 cyclic tutorial notebook
fixing FedAvg in workflow interface tutorials to be compatible with latest numpy stable release (1.24.3) (#833)
* fixing FedAvg averaging in order to be compatible with numpy v1.24+
Signed-off-by: kta-intel <kevin.ta@intel.com>
* uncommenting installations for consistency with other tutorials
Signed-off-by: kta-intel <kevin.ta@intel.com>
* fixing 301_MNIST_Watermarking tutorial FedAvg
Signed-off-by: kta-intel <kevin.ta@intel.com>
* fixing 301_MNIST_Watermarki
ng tutorial FedAvg
Signed-off-by: kta-intel <kevin.ta@intel.com>
* Switching to py38 kernel and clearing cell outputs
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolved merge conflicts in tests/github/experimental/testflow_datastore_cli.py
Testflow for verifying stdout redirection to Metaflow datastore (#758)
* implemented ray.wait
* reverted changes back after testing
* adding datastore cli test case
* removed unused variables
* removed stderr validation
* fixed lint suggestions
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added weighted_average aggregation function under openfl.experimental.interface.{keras,torch}.aggregation_funtions
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update EdenPipeline in the documentation (#877)
Signed-off-by: Amit Portnoy <1131991+amitport@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* WIP: CI Scans (#873)
* Initial scans commit for bandit, hadolint, trivy
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Address bandit scan results
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix Trivy action
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix linting
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add Coverity Badge
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update Hadolint threshold to flag errors only
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update Hadolint threshold to flag errors only
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update ROADMAP.md (#878)
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* initial commit
* add docstrings
* change importlib to import
* remove unnecesary files, replace ray with ray_grouped
* remove max concurency, add number of actors
* Trigger CI
* run tests
* lint changes
* flake
* changed number of actors to num_actors, added docs
* Fixed workflow API tests
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* lint fixes
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <Parthx.Mandaliya@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
Signed-off-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Signed-off-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: kta-intel <kevin.ta@intel.com>
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
Signed-off-by: Amit Portnoy <1131991+amitport@users.noreply.github.com>
Co-authored-by: Patrick Foley <patrick.foley@intel.com>
Co-authored-by: Olga Perepelkina <olga.perepelkina@intel.com>
Co-authored-by: Joe Devon <138038+joedevon@users.noreply.github.com>
Co-authored-by: Sarthak Pati <sarthak.pati@hotmail.com>
Co-authored-by: Prashant Shah <40899779+SprashAI@users.noreply.github.com>
Co-authored-by: akantak <aleksander.kantak@intel.com>
Co-authored-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Co-authored-by: Parth Mandaliya <Parthx@Mandaliya.intel.com>
Co-authored-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Co-authored-by: Keerti Talwar <keertix.talwar@intel.com>
Co-authored-by: KeertiX <keertix.talwarx@intel.com>
Co-authored-by: wangleflex <106506636+wangleflex@users.noreply.github.com>
Co-authored-by: He, Dan H <dan.h.he@intel.com>
Co-authored-by: xiaoranf <desolatefang@gmail.com>
Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com>
Co-authored-by: Lei5 Chen <lei5.chen@intel.com>
Co-authored-by: Beverly Klemme <35578090+bjklemme-intel@users.noreply.github.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Co-authored-by: Yi CAO <yi2.cao@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Co-authored-by: Francis Storr <francis.storr@intel.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com>
Co-authored-by: kta-intel <kevin.ta@intel.com>
Co-authored-by: Mansi Sharma <77758170+mansishr@users.noreply.github.com>
Co-authored-by: Mansi Sharma <mansi.sharma@intel.com>
Co-authored-by: Sachin Gupta <sachin.gupta.dsp@gmail.com>
Co-authored-by: Keerti Prakash Talwar <115972088+KeertiX@users.noreply.github.com>
Co-authored-by: Amit Portnoy <1131991+amitport@users.noreply.github.com>
Signed-off-by: nammbash <niroopshankar.ammbashankar@intel.com>
nammbash
pushed a commit
to nammbash/openfl
that referenced
this pull request
Feb 29, 2024
* Fix flake8 error in local runtime (#764)
* Removes unnecessary dict comprehension
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Removes unnecessary dict comprehension
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update ROADMAP.md (#765)
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update README.md
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update GOVERNANCE.md
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update ROADMAP.md (#785)
Typos
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated integrations to GaNDLF (#781)
* renaming loader and runner
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
* updated plan to pick the new names
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
* new key name
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
* allow the ability to pass a file to `gandlf_config_dict` in addition to fully-fledged parameters
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
* checking this differently
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
* rename variable for clarity
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
---------
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update README.md
Removed references to Intel's ownship, given it's now owned by the LF AI and Data.
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fix Flake8 C419 for Ubuntu CI (#800)
C419 Unnecessary list comprehension passed to any()/all() prevents short-circuiting - rewrite as a generator
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Introduced shard descriptor based collaborator private attributes
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Adding batch size for train, and test in config.yaml file
Files modified:
1. config.yaml
2. mnist_shard_descriptor.py
3. Workflow_Interface_101_MNIST.ipynb
4. participants.py
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Introducing multiple config yaml files
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removing unnecessary config.yaml file.
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added collaborator private atribute delayed initialization
for local_runtime
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Incorporated review comments
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added multi-pricessing ray backend support and, aggregator yaml file
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated multi-processing code
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* RayExecutor class moved from participants.py to localruntime.py
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* RayExecytor moved from interface/pariticipants.py to
runtime/local_runtime.py
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added Aggregator private attribute initialation in runtime
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removed unnecessary import statements
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Code cleaned up, validated checkpoints manually
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Refactored, and added some new doc string
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolved Flake8 instructions
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Recusrsion removal + Serialization removal integrated
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Incoporated Review Comments
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removed configuration YAML files, and
added functionality to initialize private attributes by calling a
callback function created by end-user
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removed commented code
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Implemented new approach, two example files given
1. Workflow_Interface_101_MNIST.py
2. Workflow_Interface_301_MNIST_Watermarking.py
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Internal Review Comments Incorporated
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* No private attributes are required
If private attributes are not provided, by default take an empty dictionary no need to pass a callable function.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update participants.py
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added a check for GPU Resource Allocation
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified error message for resource allocation
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolved bug found during testing phase
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modifide all the test cases, and following tutorials
1. Privacy Meter
2. FedProx
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added following test cases:
1. Workflow_Interface_101_MNIST.ipynb
2. Workflow_Interface_102_Aggregator_Validation.ipynb
3. Workflow_Interface_301_MNIST_Watermarking.ipynb
4. Workflow_Interface_201_Exclusive_GPUs_with_Ray.ipynb
5. Workflow_Interface_103_Cyclic_Institutional_Incremental_Learning.ipynb
Signed-off-by: Parth Mandaliya <Parthx.Mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified and Added Global_DP tutorials.
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified and Added tutorial Workflow-Interface_201_Exclusive_GPUs_with_Ray.ipynb
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified documentation for Workflow_Interface_201 tutorial.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* fixed flake-8 errors
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* reverted import module code
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolved merge conflicts in local_runtime.py
---------
Fix flake8 error in local runtime (#764)
* Removes unnecessary dict comprehension
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Removes unnecessary dict comprehension
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update README.md
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fix warnings and issues in docs (#825)
* Fix warnings and issues in docs
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
* fixup! Fix warnings and issues in docs
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
---------
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Add Logo (#827)
* Add Logo
* Update README.md
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Change OpenFL documentation font to improve accessibility (#809)
This replaces the font of OpenFL documents with Intel One Mono font for low vision developers.
Known issues:
1. The text font within the images has not been changed.
2. Some icons that do not exist in the new font cannot be displayed properly.
Fixes securefederatedai#799
Co-authored-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Co-authored-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update unit tests to improve code coverage (#821)
* Update ci config
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add unit test for following files
- openfl/federated/plan/plan.py
- openfl/interface/aggregation_functions/core/adaptive_aggregation.py
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add some test cases for databases module
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Fix bugs for databases module unittest
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Update unit tests for component module
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Restore workflow config and update some comments
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Enable save_ test case.
Add yaml under test dir for unit test usage.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove plan to new dir.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove plan to new dir.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add aggregator start test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 2 aggregator test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 1 aggregator test case.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Format code.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Refactor code.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add collaborator start test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 1 collaborator test case.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Format with flake8
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove TODO comments
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
---------
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com>
Co-authored-by: Lei5 Chen <lei5.chen@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Add PyTorch linear regression example (#808)
This adds a new tutorial example on distributing a linear regression task over OpenFL cluster.
The model is defined by Pytorch which is able to run over both cpu (by default) and gpu. The dataset is generated by make_regression from sklearn.datasets with pre-defined parameters.
Fixes #797
Co-authored-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* This prints out the hash of the CSR to disk for both the aggregator and (#813)
* This prints out the hash of the CSR to disk for both the aggregator and
collaborator. The user then compares and approves this hash with the
hash printed out of the file to validate the CSR. In addition, a warning
message is pritned if certify is run in silent mode.
Fixes securefederatedai#692
Signed-off-by: Grant Baker <grant.baker@intel.com>
* Refactor read_csr function to use get_csr_hash
Signed-off-by: Grant Baker <grant.baker@intel.com>
* Ask to check hashes before prompt
---------
Signed-off-by: Grant Baker <grant.baker@intel.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Improve workspace requirements import (#810)
Remove the dump_requirement_file operation in export_ method.
Fixes securefederatedai#767
Co-authored-by: Li, Qingqing <qingqing.li@intel.com>
Co-authored-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Issue 506 Added Example using FedProx (#818)
* created new ineractive_api dir to hold pytorch fedprox mnist example
corrected files
changed to FedProxOptimizer and ran set_old_weights for new FedProx Pytorch example
renamed FedProx notebook
used mode.parrameters() to get pytorch model weights
got weights using state_dict
changed old wieghts to list (for serialization) and fixed README
input wieghts before zero_grad
[Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api
This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.
Fixes: #506
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api
This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.
Fixes: securefederatedai#506
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* Update README.md
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* addressed comments by psfoley: corrected words in the jupyter notebook metadata and added a link to the FedProx paper in the README.
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
---------
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* [Bug: 768] FX CLI: Separate create, cert gen commands (#807)
This change separates existing command
"fx collaborator.py generate-cert-request" command into two
commands.
"fx collaborator create -n {NAME} -d {DATA_PATH: optional}".
"fx collaborator generate-cert-request -n {NAME}".
Fixes #768
Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Add new tutorial example to OpenFL interactive API (#812)
* Add new tutorial example to OpenFL interactive API
This adds a new tutorial example on distributing a linear regression task over OpenFL cluster
The model is defined by scikit-learn which is able to run over both cpu (by default) and gpu. The dataset is 1-dimensional noisy data of sinusoid with pre-defined parameters.
Fixes #798
Co-authored-by: Beverly Klemme <beverly.klemme@intel.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Yi CAO <yi2.cao@intel.com>
* reduced requirements.txt in workspace
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
---------
Signed-off-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Co-authored-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow in /openfl-workspace/tf_cnn_histology (#776)
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow (#777)
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Running a federation with GaNDLF Documentation (#794)
* Initial commit of Running the federation with GaNDLF Documentation
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update README.md
Removed references to Intel's ownship, given it's now owned by the LF AI and Data.
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix Flake8 C419 for Ubuntu CI (#800)
C419 Unnecessary list comprehension passed to any()/all() prevents short-circuiting - rewrite as a generator
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update README.md
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix warnings and issues in docs (#825)
* Fix warnings and issues in docs
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
* fixup! Fix warnings and issues in docs
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
---------
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add Logo (#827)
* Add Logo
* Update README.md
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Change OpenFL documentation font to improve accessibility (#809)
This replaces the font of OpenFL documents with Intel One Mono font for low vision developers.
Known issues:
1. The text font within the images has not been changed.
2. Some icons that do not exist in the new font cannot be displayed properly.
Fixes securefederatedai#799
Co-authored-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Co-authored-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update unit tests to improve code coverage (#821)
* Update ci config
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add unit test for following files
- openfl/federated/plan/plan.py
- openfl/interface/aggregation_functions/core/adaptive_aggregation.py
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add some test cases for databases module
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Fix bugs for databases module unittest
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Update unit tests for component module
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Restore workflow config and update some comments
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Enable save_ test case.
Add yaml under test dir for unit test usage.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove plan to new dir.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove plan to new dir.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add aggregator start test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 2 aggregator test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 1 aggregator test case.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Format code.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Refactor code.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add collaborator start test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 1 collaborator test case.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Format with flake8
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove TODO comments
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
---------
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com>
Co-authored-by: Lei5 Chen <lei5.chen@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add PyTorch linear regression example (#808)
This adds a new tutorial example on distributing a linear regression task over OpenFL cluster.
The model is defined by Pytorch which is able to run over both cpu (by default) and gpu. The dataset is generated by make_regression from sklearn.datasets with pre-defined parameters.
Fixes #797
Co-authored-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* This prints out the hash of the CSR to disk for both the aggregator and (#813)
* This prints out the hash of the CSR to disk for both the aggregator and
collaborator. The user then compares and approves this hash with the
hash printed out of the file to validate the CSR. In addition, a warning
message is pritned if certify is run in silent mode.
Fixes securefederatedai#692
Signed-off-by: Grant Baker <grant.baker@intel.com>
* Refactor read_csr function to use get_csr_hash
Signed-off-by: Grant Baker <grant.baker@intel.com>
* Ask to check hashes before prompt
---------
Signed-off-by: Grant Baker <grant.baker@intel.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Improve workspace requirements import (#810)
Remove the dump_requirement_file operation in export_ method.
Fixes securefederatedai#767
Co-authored-by: Li, Qingqing <qingqing.li@intel.com>
Co-authored-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Issue 506 Added Example using FedProx (#818)
* created new ineractive_api dir to hold pytorch fedprox mnist example
corrected files
changed to FedProxOptimizer and ran set_old_weights for new FedProx Pytorch example
renamed FedProx notebook
used mode.parrameters() to get pytorch model weights
got weights using state_dict
changed old wieghts to list (for serialization) and fixed README
input wieghts before zero_grad
[Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api
This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.
Fixes: #506
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api
This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.
Fixes: securefederatedai#506
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* Update README.md
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* addressed comments by psfoley: corrected words in the jupyter notebook metadata and added a link to the FedProx paper in the README.
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
---------
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* [Bug: 768] FX CLI: Separate create, cert gen commands (#807)
This change separates existing command
"fx collaborator.py generate-cert-request" command into two
commands.
"fx collaborator create -n {NAME} -d {DATA_PATH: optional}".
"fx collaborator generate-cert-request -n {NAME}".
Fixes #768
Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add new tutorial example to OpenFL interactive API (#812)
* Add new tutorial example to OpenFL interactive API
This adds a new tutorial example on distributing a linear regression task over OpenFL cluster
The model is defined by scikit-learn which is able to run over both cpu (by default) and gpu. The dataset is 1-dimensional noisy data of sinusoid with pre-defined parameters.
Fixes #798
Co-authored-by: Beverly Klemme <beverly.klemme@intel.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Yi CAO <yi2.cao@intel.com>
* reduced requirements.txt in workspace
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
---------
Signed-off-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Co-authored-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* build(deps): bump tensorflow in /openfl-workspace/tf_cnn_histology (#776)
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* build(deps): bump tensorflow (#777)
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update GaNDLF repo location and test CI with master branch
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update GaNDLF repo location and test CI with master branch
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update GaNDLF repo location and test CI with master branch
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix documentation links. Change path names and templates for CI
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix paths
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix paths
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix breaking tests
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add compatible onnx version to requirements.txt file
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix wrong csv file name
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix wrong csv file name
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix wrong names in workflow file
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix wrong data path
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix lint in test_gandlf.py
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix lint errors
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Signed-off-by: Yi CAO <yi2.cao@intel.com>
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Co-authored-by: Prashant Shah <40899779+SprashAI@users.noreply.github.com>
Co-authored-by: akantak <aleksander.kantak@intel.com>
Co-authored-by: wangleflex <106506636+wangleflex@users.noreply.github.com>
Co-authored-by: He, Dan H <dan.h.he@intel.com>
Co-authored-by: xiaoranf <desolatefang@gmail.com>
Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com>
Co-authored-by: Lei5 Chen <lei5.chen@intel.com>
Co-authored-by: Beverly Klemme <35578090+bjklemme-intel@users.noreply.github.com>
Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Co-authored-by: Yi CAO <yi2.cao@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid (#841)
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fix GaNDLF documentation links (#842)
* Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix links in GaNDLF Documentation
* Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix links in GaNDLF Documentation
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fix incorrectly formatted link in docs (#839)
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolving merge conflicts in local-runtime.py
Integrated aggregator as stateful actor branch, tested.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
--------
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump onnx in /openfl-workspace/gandlf_seg_test (#840)
Bumps [onnx](https://github.com/onnx/onnx) from 1.12 to 1.13.0.
- [Release notes](https://github.com/onnx/onnx/releases)
- [Changelog](https://github.com/onnx/onnx/blob/main/docs/Changelog.md)
- [Commits](https://github.com/onnx/onnx/compare/v1.12.0...v1.13.0)
---
updated-dependencies:
- dependency-name: onnx
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Merged changes of remove-torch-dependency branch
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update setup.py
Upgrading protobuf to 3.20.3 as per tensorboard requirement
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolving merge conflicts
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Accessibility updates (#861)
* Fix incorrectly formatted link in docs
Signed-off-by: Francis Storr <francis.storr@intel.com>
* Font styling, color contrast, other accessibility updates
This update:
1. Restores Roboto and Lato fonts for most body copy, leaving Intel One Mono for code samples.
2. Adds colors (in `colors.css`)
3. Adds a new `accessibility_overrides.css` file containing CSS that improves the accessibility of the documentation and, where possible, Read The Docs. These updates remediate numerous non-conforming WCAG 2.x Level AA bugs. The use of a separate file for this hopefully makes these changes easier to manage and less likely to be accessibility overwritten in the future.
Closes #848
Signed-off-by: Francis Storr <francis.storr@intel.com>
---------
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_nlp (#773)
* build(deps): bump tensorflow in /openfl-workspace/keras_nlp
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update RMSProp optimizer import
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* flake8
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_cnn_mnist (#771)
* build(deps): bump tensorflow in /openfl-workspace/keras_cnn_mnist
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* revert experimental Adam to legacy (#863)
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: kta-intel <kevin.ta@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_cnn_with_compression (#770)
* build(deps): bump tensorflow
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update Adam Optimizer import
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.9.3 to 2.11.1 in /openfl-tutorials/interactive_api/Flax_CNN_CIFAR (#775)
* build(deps): bump tensorflow
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* Fixed breaking backages
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add quiet flag back to pip install
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow-cpu from 2.8.4 to 2.11.1 in /openfl-workspace/keras_nlp_gramine_ready (#769)
* build(deps): bump tensorflow-cpu
Bumps [tensorflow-cpu](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow-cpu
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* Use legacy RMSprop optimizer
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Accessibility color contrast fixes (#864)
* Fix incorrectly formatted link in docs
Signed-off-by: Francis Storr <francis.storr@intel.com>
* Font styling, color contrast, other accessibility updates
This update:
1. Restores Roboto and Lato fonts for most body copy, leaving Intel One Mono for code samples.
2. Adds colors (in `colors.css`)
3. Adds a new `accessibility_overrides.css` file containing CSS that improves the accessibility of the documentation and, where possible, Read The Docs. These updates remediate numerous non-conforming WCAG 2.x Level AA bugs. The use of a separate file for this hopefully makes these changes easier to manage and less likely to be accessibility overwritten in the future.
Closes #848
Signed-off-by: Francis Storr <francis.storr@intel.com>
* Color contrast updates for accessibility
Color contrast updates for accessibility
- update generic `a` element
- update color of links in the toggle-able read-the-docs panel
- update the color of the text in search results
- update the color of notes headers
Signed-off-by: Francis Storr <francis.storr@intel.com>
---------
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Tweak link color so it’s not so aggressive (#865)
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /tests/github/interactive_api_director/experiments/tensorflow_mnist/envoy (#772)
* build(deps): bump tensorflow
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* Update sd_requirements.txt
* revert to legacy SGD and install tensorflow==2.11 for workflow
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: kta-intel <kevin.ta@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <patrick.foley@intel.com>
Co-authored-by: kta-intel <kevin.ta@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/tf_2dunet (#774)
* build(deps): bump tensorflow in /openfl-workspace/tf_2dunet
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* Update requirements.txt
to retrigger CI
* Update requirements.txt
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update Tensorflow, gRPC, Protobuf dependencies (#868)
* Update Tensorflow to latest, finally update grpcio/protobuf
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Lint issue fix and missing tf reference
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* pyzmq version fixed
* fix taskrunner tests for windows
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* fix taskrunner test syntax for windows
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* adding user option to workspace pip install requirements for windows
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* fix windows CI test
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* testing virtual env for windows github actions
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* testing virtual env for windows github actions
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* testing virtual env for windows github actions
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* testing venv for windows
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* test venv for windows
* test venv for windows
* Added new KerasSerializer. Fixed other Interactive API experiments
* Update taskrunner.yml
* Update taskrunner.yml
* Update workspace.py
* Update workspace.py
* Update taskrunner.yml
* Remove get_model import from global namespace so dependencies are not loaded into memory unnecessarily (breaking windows build)
* Refactoring and cleaning up imports to support Windows install
* Fixed logger import paths
* Fix missing imports
* Fix native import
* Fix lint errors
* Fix keras optimizer patch. Remove irrelevant unit test
* Format logs in UTF-8 for windows
* Update interactive-kvasir.yml
* Consolidate github actions python versions to single file
* Update python versions
* Update python versions
* Update python versions
* Reduce # of DataLoader workers for Pytorch Kvasir CI test
* Fix Windows encoding
* Fix Windows encoding and limit rounds so Github Actions CI doesn't run out of memory
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix windows encoding
* Fix Windows encoding
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
Co-authored-by: Mansi Sharma <77758170+mansishr@users.noreply.github.com>
Co-authored-by: Mansi Sharma <mansi.sharma@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Add FL plan description to documentation (#872)
* Add plan description to documentation
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* fix indentation
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* Apply suggestions from code review
Co-authored-by: Patrick Foley <patrick.foley@intel.com>
---------
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
Co-authored-by: Patrick Foley <patrick.foley@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolved flake8 issues
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* GPU Added for aggregator
Fixed issue in 103 Cyclic Institutional Incremental Learning tutorial
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolve Coverity Issues (#874)
* Fix coverity issues
* Resolve remaining coverity issues
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Migrate to Ubuntu 22.04 LTS release (supported through 2027) (#875)
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated documentation:
docs/workflow_interface.rst
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated documentation
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update workflow_interface.rst
Fixing typo
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added best model and last model extraction technique in docs/workflow_interface.rst
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added GPU for aggregator
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolving merge conflicts in 103 cyclic tutorial notebook
fixing FedAvg in workflow interface tutorials to be compatible with latest numpy stable release (1.24.3) (#833)
* fixing FedAvg averaging in order to be compatible with numpy v1.24+
Signed-off-by: kta-intel <kevin.ta@intel.com>
* uncommenting installations for consistency with other tutorials
Signed-off-by: kta-intel <kevin.ta@intel.com>
* fixing 301_MNIST_Watermarking tutorial FedAvg
Signed-off-by: kta-intel <kevin.ta@intel.com>
* fixing 301_MNIST_Watermarki
ng tutorial FedAvg
Signed-off-by: kta-intel <kevin.ta@intel.com>
* Switching to py38 kernel and clearing cell outputs
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolved merge conflicts in tests/github/experimental/testflow_datastore_cli.py
Testflow for verifying stdout redirection to Metaflow datastore (#758)
* implemented ray.wait
* reverted changes back after testing
* adding datastore cli test case
* removed unused variables
* removed stderr validation
* fixed lint suggestions
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added weighted_average aggregation function under openfl.experimental.interface.{keras,torch}.aggregation_funtions
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update EdenPipeline in the documentation (#877)
Signed-off-by: Amit Portnoy <1131991+amitport@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* WIP: CI Scans (#873)
* Initial scans commit for bandit, hadolint, trivy
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Address bandit scan results
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix Trivy action
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix linting
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add Coverity Badge
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update Hadolint threshold to flag errors only
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update Hadolint threshold to flag errors only
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update ROADMAP.md (#878)
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* initial commit
* add docstrings
* change importlib to import
* remove unnecesary files, replace ray with ray_grouped
* remove max concurency, add number of actors
* Trigger CI
* run tests
* lint changes
* flake
* changed number of actors to num_actors, added docs
* Fixed workflow API tests
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* lint fixes
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <Parthx.Mandaliya@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
Signed-off-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Signed-off-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: kta-intel <kevin.ta@intel.com>
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
Signed-off-by: Amit Portnoy <1131991+amitport@users.noreply.github.com>
Co-authored-by: Patrick Foley <patrick.foley@intel.com>
Co-authored-by: Olga Perepelkina <olga.perepelkina@intel.com>
Co-authored-by: Joe Devon <138038+joedevon@users.noreply.github.com>
Co-authored-by: Sarthak Pati <sarthak.pati@hotmail.com>
Co-authored-by: Prashant Shah <40899779+SprashAI@users.noreply.github.com>
Co-authored-by: akantak <aleksander.kantak@intel.com>
Co-authored-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Co-authored-by: Parth Mandaliya <Parthx@Mandaliya.intel.com>
Co-authored-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Co-authored-by: Keerti Talwar <keertix.talwar@intel.com>
Co-authored-by: KeertiX <keertix.talwarx@intel.com>
Co-authored-by: wangleflex <106506636+wangleflex@users.noreply.github.com>
Co-authored-by: He, Dan H <dan.h.he@intel.com>
Co-authored-by: xiaoranf <desolatefang@gmail.com>
Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com>
Co-authored-by: Lei5 Chen <lei5.chen@intel.com>
Co-authored-by: Beverly Klemme <35578090+bjklemme-intel@users.noreply.github.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Co-authored-by: Yi CAO <yi2.cao@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Co-authored-by: Francis Storr <francis.storr@intel.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com>
Co-authored-by: kta-intel <kevin.ta@intel.com>
Co-authored-by: Mansi Sharma <77758170+mansishr@users.noreply.github.com>
Co-authored-by: Mansi Sharma <mansi.sharma@intel.com>
Co-authored-by: Sachin Gupta <sachin.gupta.dsp@gmail.com>
Co-authored-by: Keerti Prakash Talwar <115972088+KeertiX@users.noreply.github.com>
Co-authored-by: Amit Portnoy <1131991+amitport@users.noreply.github.com>
Signed-off-by: nammbash <niroopshankar.ammbashankar@intel.com>
nammbash
pushed a commit
to nammbash/openfl
that referenced
this pull request
Feb 29, 2024
* Fix flake8 error in local runtime (#764)
* Removes unnecessary dict comprehension
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Removes unnecessary dict comprehension
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update ROADMAP.md (#765)
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update README.md
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update GOVERNANCE.md
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update ROADMAP.md (#785)
Typos
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated integrations to GaNDLF (#781)
* renaming loader and runner
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
* updated plan to pick the new names
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
* new key name
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
* allow the ability to pass a file to `gandlf_config_dict` in addition to fully-fledged parameters
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
* checking this differently
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
* rename variable for clarity
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
---------
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update README.md
Removed references to Intel's ownship, given it's now owned by the LF AI and Data.
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fix Flake8 C419 for Ubuntu CI (#800)
C419 Unnecessary list comprehension passed to any()/all() prevents short-circuiting - rewrite as a generator
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Introduced shard descriptor based collaborator private attributes
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Adding batch size for train, and test in config.yaml file
Files modified:
1. config.yaml
2. mnist_shard_descriptor.py
3. Workflow_Interface_101_MNIST.ipynb
4. participants.py
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Introducing multiple config yaml files
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removing unnecessary config.yaml file.
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added collaborator private atribute delayed initialization
for local_runtime
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Incorporated review comments
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added multi-pricessing ray backend support and, aggregator yaml file
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated multi-processing code
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* RayExecutor class moved from participants.py to localruntime.py
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* RayExecytor moved from interface/pariticipants.py to
runtime/local_runtime.py
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added Aggregator private attribute initialation in runtime
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removed unnecessary import statements
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Code cleaned up, validated checkpoints manually
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Refactored, and added some new doc string
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolved Flake8 instructions
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Recusrsion removal + Serialization removal integrated
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Incoporated Review Comments
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removed configuration YAML files, and
added functionality to initialize private attributes by calling a
callback function created by end-user
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removed commented code
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Implemented new approach, two example files given
1. Workflow_Interface_101_MNIST.py
2. Workflow_Interface_301_MNIST_Watermarking.py
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Internal Review Comments Incorporated
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* No private attributes are required
If private attributes are not provided, by default take an empty dictionary no need to pass a callable function.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update participants.py
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added a check for GPU Resource Allocation
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified error message for resource allocation
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolved bug found during testing phase
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modifide all the test cases, and following tutorials
1. Privacy Meter
2. FedProx
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added following test cases:
1. Workflow_Interface_101_MNIST.ipynb
2. Workflow_Interface_102_Aggregator_Validation.ipynb
3. Workflow_Interface_301_MNIST_Watermarking.ipynb
4. Workflow_Interface_201_Exclusive_GPUs_with_Ray.ipynb
5. Workflow_Interface_103_Cyclic_Institutional_Incremental_Learning.ipynb
Signed-off-by: Parth Mandaliya <Parthx.Mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified and Added Global_DP tutorials.
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified and Added tutorial Workflow-Interface_201_Exclusive_GPUs_with_Ray.ipynb
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified documentation for Workflow_Interface_201 tutorial.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* fixed flake-8 errors
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* reverted import module code
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolved merge conflicts in local_runtime.py
---------
Fix flake8 error in local runtime (#764)
* Removes unnecessary dict comprehension
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Removes unnecessary dict comprehension
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update README.md
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fix warnings and issues in docs (#825)
* Fix warnings and issues in docs
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
* fixup! Fix warnings and issues in docs
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
---------
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Add Logo (#827)
* Add Logo
* Update README.md
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Change OpenFL documentation font to improve accessibility (#809)
This replaces the font of OpenFL documents with Intel One Mono font for low vision developers.
Known issues:
1. The text font within the images has not been changed.
2. Some icons that do not exist in the new font cannot be displayed properly.
Fixes securefederatedai#799
Co-authored-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Co-authored-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update unit tests to improve code coverage (#821)
* Update ci config
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add unit test for following files
- openfl/federated/plan/plan.py
- openfl/interface/aggregation_functions/core/adaptive_aggregation.py
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add some test cases for databases module
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Fix bugs for databases module unittest
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Update unit tests for component module
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Restore workflow config and update some comments
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Enable save_ test case.
Add yaml under test dir for unit test usage.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove plan to new dir.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove plan to new dir.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add aggregator start test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 2 aggregator test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 1 aggregator test case.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Format code.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Refactor code.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add collaborator start test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 1 collaborator test case.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Format with flake8
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove TODO comments
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
---------
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com>
Co-authored-by: Lei5 Chen <lei5.chen@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Add PyTorch linear regression example (#808)
This adds a new tutorial example on distributing a linear regression task over OpenFL cluster.
The model is defined by Pytorch which is able to run over both cpu (by default) and gpu. The dataset is generated by make_regression from sklearn.datasets with pre-defined parameters.
Fixes #797
Co-authored-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* This prints out the hash of the CSR to disk for both the aggregator and (#813)
* This prints out the hash of the CSR to disk for both the aggregator and
collaborator. The user then compares and approves this hash with the
hash printed out of the file to validate the CSR. In addition, a warning
message is pritned if certify is run in silent mode.
Fixes securefederatedai#692
Signed-off-by: Grant Baker <grant.baker@intel.com>
* Refactor read_csr function to use get_csr_hash
Signed-off-by: Grant Baker <grant.baker@intel.com>
* Ask to check hashes before prompt
---------
Signed-off-by: Grant Baker <grant.baker@intel.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Improve workspace requirements import (#810)
Remove the dump_requirement_file operation in export_ method.
Fixes securefederatedai#767
Co-authored-by: Li, Qingqing <qingqing.li@intel.com>
Co-authored-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Issue 506 Added Example using FedProx (#818)
* created new ineractive_api dir to hold pytorch fedprox mnist example
corrected files
changed to FedProxOptimizer and ran set_old_weights for new FedProx Pytorch example
renamed FedProx notebook
used mode.parrameters() to get pytorch model weights
got weights using state_dict
changed old wieghts to list (for serialization) and fixed README
input wieghts before zero_grad
[Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api
This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.
Fixes: #506
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api
This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.
Fixes: securefederatedai#506
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* Update README.md
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* addressed comments by psfoley: corrected words in the jupyter notebook metadata and added a link to the FedProx paper in the README.
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
---------
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* [Bug: 768] FX CLI: Separate create, cert gen commands (#807)
This change separates existing command
"fx collaborator.py generate-cert-request" command into two
commands.
"fx collaborator create -n {NAME} -d {DATA_PATH: optional}".
"fx collaborator generate-cert-request -n {NAME}".
Fixes #768
Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Add new tutorial example to OpenFL interactive API (#812)
* Add new tutorial example to OpenFL interactive API
This adds a new tutorial example on distributing a linear regression task over OpenFL cluster
The model is defined by scikit-learn which is able to run over both cpu (by default) and gpu. The dataset is 1-dimensional noisy data of sinusoid with pre-defined parameters.
Fixes #798
Co-authored-by: Beverly Klemme <beverly.klemme@intel.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Yi CAO <yi2.cao@intel.com>
* reduced requirements.txt in workspace
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
---------
Signed-off-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Co-authored-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow in /openfl-workspace/tf_cnn_histology (#776)
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow (#777)
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Running a federation with GaNDLF Documentation (#794)
* Initial commit of Running the federation with GaNDLF Documentation
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update README.md
Removed references to Intel's ownship, given it's now owned by the LF AI and Data.
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix Flake8 C419 for Ubuntu CI (#800)
C419 Unnecessary list comprehension passed to any()/all() prevents short-circuiting - rewrite as a generator
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update README.md
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix warnings and issues in docs (#825)
* Fix warnings and issues in docs
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
* fixup! Fix warnings and issues in docs
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
---------
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add Logo (#827)
* Add Logo
* Update README.md
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Change OpenFL documentation font to improve accessibility (#809)
This replaces the font of OpenFL documents with Intel One Mono font for low vision developers.
Known issues:
1. The text font within the images has not been changed.
2. Some icons that do not exist in the new font cannot be displayed properly.
Fixes securefederatedai#799
Co-authored-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Co-authored-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update unit tests to improve code coverage (#821)
* Update ci config
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add unit test for following files
- openfl/federated/plan/plan.py
- openfl/interface/aggregation_functions/core/adaptive_aggregation.py
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add some test cases for databases module
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Fix bugs for databases module unittest
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Update unit tests for component module
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Restore workflow config and update some comments
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Enable save_ test case.
Add yaml under test dir for unit test usage.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove plan to new dir.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove plan to new dir.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add aggregator start test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 2 aggregator test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 1 aggregator test case.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Format code.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Refactor code.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add collaborator start test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 1 collaborator test case.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Format with flake8
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove TODO comments
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
---------
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com>
Co-authored-by: Lei5 Chen <lei5.chen@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add PyTorch linear regression example (#808)
This adds a new tutorial example on distributing a linear regression task over OpenFL cluster.
The model is defined by Pytorch which is able to run over both cpu (by default) and gpu. The dataset is generated by make_regression from sklearn.datasets with pre-defined parameters.
Fixes #797
Co-authored-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* This prints out the hash of the CSR to disk for both the aggregator and (#813)
* This prints out the hash of the CSR to disk for both the aggregator and
collaborator. The user then compares and approves this hash with the
hash printed out of the file to validate the CSR. In addition, a warning
message is pritned if certify is run in silent mode.
Fixes securefederatedai#692
Signed-off-by: Grant Baker <grant.baker@intel.com>
* Refactor read_csr function to use get_csr_hash
Signed-off-by: Grant Baker <grant.baker@intel.com>
* Ask to check hashes before prompt
---------
Signed-off-by: Grant Baker <grant.baker@intel.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Improve workspace requirements import (#810)
Remove the dump_requirement_file operation in export_ method.
Fixes securefederatedai#767
Co-authored-by: Li, Qingqing <qingqing.li@intel.com>
Co-authored-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Issue 506 Added Example using FedProx (#818)
* created new ineractive_api dir to hold pytorch fedprox mnist example
corrected files
changed to FedProxOptimizer and ran set_old_weights for new FedProx Pytorch example
renamed FedProx notebook
used mode.parrameters() to get pytorch model weights
got weights using state_dict
changed old wieghts to list (for serialization) and fixed README
input wieghts before zero_grad
[Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api
This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.
Fixes: #506
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api
This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.
Fixes: securefederatedai#506
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* Update README.md
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* addressed comments by psfoley: corrected words in the jupyter notebook metadata and added a link to the FedProx paper in the README.
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
---------
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* [Bug: 768] FX CLI: Separate create, cert gen commands (#807)
This change separates existing command
"fx collaborator.py generate-cert-request" command into two
commands.
"fx collaborator create -n {NAME} -d {DATA_PATH: optional}".
"fx collaborator generate-cert-request -n {NAME}".
Fixes #768
Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add new tutorial example to OpenFL interactive API (#812)
* Add new tutorial example to OpenFL interactive API
This adds a new tutorial example on distributing a linear regression task over OpenFL cluster
The model is defined by scikit-learn which is able to run over both cpu (by default) and gpu. The dataset is 1-dimensional noisy data of sinusoid with pre-defined parameters.
Fixes #798
Co-authored-by: Beverly Klemme <beverly.klemme@intel.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Yi CAO <yi2.cao@intel.com>
* reduced requirements.txt in workspace
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
---------
Signed-off-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Co-authored-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* build(deps): bump tensorflow in /openfl-workspace/tf_cnn_histology (#776)
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* build(deps): bump tensorflow (#777)
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update GaNDLF repo location and test CI with master branch
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update GaNDLF repo location and test CI with master branch
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update GaNDLF repo location and test CI with master branch
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix documentation links. Change path names and templates for CI
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix paths
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix paths
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix breaking tests
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add compatible onnx version to requirements.txt file
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix wrong csv file name
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix wrong csv file name
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix wrong names in workflow file
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix wrong data path
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix lint in test_gandlf.py
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix lint errors
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Signed-off-by: Yi CAO <yi2.cao@intel.com>
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Co-authored-by: Prashant Shah <40899779+SprashAI@users.noreply.github.com>
Co-authored-by: akantak <aleksander.kantak@intel.com>
Co-authored-by: wangleflex <106506636+wangleflex@users.noreply.github.com>
Co-authored-by: He, Dan H <dan.h.he@intel.com>
Co-authored-by: xiaoranf <desolatefang@gmail.com>
Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com>
Co-authored-by: Lei5 Chen <lei5.chen@intel.com>
Co-authored-by: Beverly Klemme <35578090+bjklemme-intel@users.noreply.github.com>
Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Co-authored-by: Yi CAO <yi2.cao@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid (#841)
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fix GaNDLF documentation links (#842)
* Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix links in GaNDLF Documentation
* Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix links in GaNDLF Documentation
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fix incorrectly formatted link in docs (#839)
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolving merge conflicts in local-runtime.py
Integrated aggregator as stateful actor branch, tested.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
--------
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump onnx in /openfl-workspace/gandlf_seg_test (#840)
Bumps [onnx](https://github.com/onnx/onnx) from 1.12 to 1.13.0.
- [Release notes](https://github.com/onnx/onnx/releases)
- [Changelog](https://github.com/onnx/onnx/blob/main/docs/Changelog.md)
- [Commits](https://github.com/onnx/onnx/compare/v1.12.0...v1.13.0)
---
updated-dependencies:
- dependency-name: onnx
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Merged changes of remove-torch-dependency branch
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update setup.py
Upgrading protobuf to 3.20.3 as per tensorboard requirement
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolving merge conflicts
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Accessibility updates (#861)
* Fix incorrectly formatted link in docs
Signed-off-by: Francis Storr <francis.storr@intel.com>
* Font styling, color contrast, other accessibility updates
This update:
1. Restores Roboto and Lato fonts for most body copy, leaving Intel One Mono for code samples.
2. Adds colors (in `colors.css`)
3. Adds a new `accessibility_overrides.css` file containing CSS that improves the accessibility of the documentation and, where possible, Read The Docs. These updates remediate numerous non-conforming WCAG 2.x Level AA bugs. The use of a separate file for this hopefully makes these changes easier to manage and less likely to be accessibility overwritten in the future.
Closes #848
Signed-off-by: Francis Storr <francis.storr@intel.com>
---------
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_nlp (#773)
* build(deps): bump tensorflow in /openfl-workspace/keras_nlp
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update RMSProp optimizer import
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* flake8
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_cnn_mnist (#771)
* build(deps): bump tensorflow in /openfl-workspace/keras_cnn_mnist
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* revert experimental Adam to legacy (#863)
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: kta-intel <kevin.ta@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_cnn_with_compression (#770)
* build(deps): bump tensorflow
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update Adam Optimizer import
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.9.3 to 2.11.1 in /openfl-tutorials/interactive_api/Flax_CNN_CIFAR (#775)
* build(deps): bump tensorflow
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* Fixed breaking backages
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add quiet flag back to pip install
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow-cpu from 2.8.4 to 2.11.1 in /openfl-workspace/keras_nlp_gramine_ready (#769)
* build(deps): bump tensorflow-cpu
Bumps [tensorflow-cpu](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow-cpu
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* Use legacy RMSprop optimizer
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Accessibility color contrast fixes (#864)
* Fix incorrectly formatted link in docs
Signed-off-by: Francis Storr <francis.storr@intel.com>
* Font styling, color contrast, other accessibility updates
This update:
1. Restores Roboto and Lato fonts for most body copy, leaving Intel One Mono for code samples.
2. Adds colors (in `colors.css`)
3. Adds a new `accessibility_overrides.css` file containing CSS that improves the accessibility of the documentation and, where possible, Read The Docs. These updates remediate numerous non-conforming WCAG 2.x Level AA bugs. The use of a separate file for this hopefully makes these changes easier to manage and less likely to be accessibility overwritten in the future.
Closes #848
Signed-off-by: Francis Storr <francis.storr@intel.com>
* Color contrast updates for accessibility
Color contrast updates for accessibility
- update generic `a` element
- update color of links in the toggle-able read-the-docs panel
- update the color of the text in search results
- update the color of notes headers
Signed-off-by: Francis Storr <francis.storr@intel.com>
---------
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Tweak link color so it’s not so aggressive (#865)
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /tests/github/interactive_api_director/experiments/tensorflow_mnist/envoy (#772)
* build(deps): bump tensorflow
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* Update sd_requirements.txt
* revert to legacy SGD and install tensorflow==2.11 for workflow
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: kta-intel <kevin.ta@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <patrick.foley@intel.com>
Co-authored-by: kta-intel <kevin.ta@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/tf_2dunet (#774)
* build(deps): bump tensorflow in /openfl-workspace/tf_2dunet
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* Update requirements.txt
to retrigger CI
* Update requirements.txt
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update Tensorflow, gRPC, Protobuf dependencies (#868)
* Update Tensorflow to latest, finally update grpcio/protobuf
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Lint issue fix and missing tf reference
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* pyzmq version fixed
* fix taskrunner tests for windows
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* fix taskrunner test syntax for windows
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* adding user option to workspace pip install requirements for windows
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* fix windows CI test
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* testing virtual env for windows github actions
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* testing virtual env for windows github actions
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* testing virtual env for windows github actions
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* testing venv for windows
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* test venv for windows
* test venv for windows
* Added new KerasSerializer. Fixed other Interactive API experiments
* Update taskrunner.yml
* Update taskrunner.yml
* Update workspace.py
* Update workspace.py
* Update taskrunner.yml
* Remove get_model import from global namespace so dependencies are not loaded into memory unnecessarily (breaking windows build)
* Refactoring and cleaning up imports to support Windows install
* Fixed logger import paths
* Fix missing imports
* Fix native import
* Fix lint errors
* Fix keras optimizer patch. Remove irrelevant unit test
* Format logs in UTF-8 for windows
* Update interactive-kvasir.yml
* Consolidate github actions python versions to single file
* Update python versions
* Update python versions
* Update python versions
* Reduce # of DataLoader workers for Pytorch Kvasir CI test
* Fix Windows encoding
* Fix Windows encoding and limit rounds so Github Actions CI doesn't run out of memory
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix windows encoding
* Fix Windows encoding
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
Co-authored-by: Mansi Sharma <77758170+mansishr@users.noreply.github.com>
Co-authored-by: Mansi Sharma <mansi.sharma@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Add FL plan description to documentation (#872)
* Add plan description to documentation
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* fix indentation
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* Apply suggestions from code review
Co-authored-by: Patrick Foley <patrick.foley@intel.com>
---------
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
Co-authored-by: Patrick Foley <patrick.foley@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolved flake8 issues
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* GPU Added for aggregator
Fixed issue in 103 Cyclic Institutional Incremental Learning tutorial
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolve Coverity Issues (#874)
* Fix coverity issues
* Resolve remaining coverity issues
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Migrate to Ubuntu 22.04 LTS release (supported through 2027) (#875)
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated documentation:
docs/workflow_interface.rst
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated documentation
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update workflow_interface.rst
Fixing typo
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added best model and last model extraction technique in docs/workflow_interface.rst
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added GPU for aggregator
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolving merge conflicts in 103 cyclic tutorial notebook
fixing FedAvg in workflow interface tutorials to be compatible with latest numpy stable release (1.24.3) (#833)
* fixing FedAvg averaging in order to be compatible with numpy v1.24+
Signed-off-by: kta-intel <kevin.ta@intel.com>
* uncommenting installations for consistency with other tutorials
Signed-off-by: kta-intel <kevin.ta@intel.com>
* fixing 301_MNIST_Watermarking tutorial FedAvg
Signed-off-by: kta-intel <kevin.ta@intel.com>
* fixing 301_MNIST_Watermarki
ng tutorial FedAvg
Signed-off-by: kta-intel <kevin.ta@intel.com>
* Switching to py38 kernel and clearing cell outputs
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolved merge conflicts in tests/github/experimental/testflow_datastore_cli.py
Testflow for verifying stdout redirection to Metaflow datastore (#758)
* implemented ray.wait
* reverted changes back after testing
* adding datastore cli test case
* removed unused variables
* removed stderr validation
* fixed lint suggestions
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added weighted_average aggregation function under openfl.experimental.interface.{keras,torch}.aggregation_funtions
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update EdenPipeline in the documentation (#877)
Signed-off-by: Amit Portnoy <1131991+amitport@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* WIP: CI Scans (#873)
* Initial scans commit for bandit, hadolint, trivy
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Address bandit scan results
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix Trivy action
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix linting
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add Coverity Badge
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update Hadolint threshold to flag errors only
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update Hadolint threshold to flag errors only
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update ROADMAP.md (#878)
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* initial commit
* add docstrings
* change importlib to import
* remove unnecesary files, replace ray with ray_grouped
* remove max concurency, add number of actors
* Trigger CI
* run tests
* lint changes
* flake
* changed number of actors to num_actors, added docs
* Fixed workflow API tests
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* lint fixes
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <Parthx.Mandaliya@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
Signed-off-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Signed-off-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: kta-intel <kevin.ta@intel.com>
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
Signed-off-by: Amit Portnoy <1131991+amitport@users.noreply.github.com>
Co-authored-by: Patrick Foley <patrick.foley@intel.com>
Co-authored-by: Olga Perepelkina <olga.perepelkina@intel.com>
Co-authored-by: Joe Devon <138038+joedevon@users.noreply.github.com>
Co-authored-by: Sarthak Pati <sarthak.pati@hotmail.com>
Co-authored-by: Prashant Shah <40899779+SprashAI@users.noreply.github.com>
Co-authored-by: akantak <aleksander.kantak@intel.com>
Co-authored-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Co-authored-by: Parth Mandaliya <Parthx@Mandaliya.intel.com>
Co-authored-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Co-authored-by: Keerti Talwar <keertix.talwar@intel.com>
Co-authored-by: KeertiX <keertix.talwarx@intel.com>
Co-authored-by: wangleflex <106506636+wangleflex@users.noreply.github.com>
Co-authored-by: He, Dan H <dan.h.he@intel.com>
Co-authored-by: xiaoranf <desolatefang@gmail.com>
Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com>
Co-authored-by: Lei5 Chen <lei5.chen@intel.com>
Co-authored-by: Beverly Klemme <35578090+bjklemme-intel@users.noreply.github.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Co-authored-by: Yi CAO <yi2.cao@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Co-authored-by: Francis Storr <francis.storr@intel.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com>
Co-authored-by: kta-intel <kevin.ta@intel.com>
Co-authored-by: Mansi Sharma <77758170+mansishr@users.noreply.github.com>
Co-authored-by: Mansi Sharma <mansi.sharma@intel.com>
Co-authored-by: Sachin Gupta <sachin.gupta.dsp@gmail.com>
Co-authored-by: Keerti Prakash Talwar <115972088+KeertiX@users.noreply.github.com>
Co-authored-by: Amit Portnoy <1131991+amitport@users.noreply.github.com>
Signed-off-by: nammbash <niroopshankar.ammbashankar@intel.com>
psfoley
added a commit
that referenced
this pull request
Mar 1, 2024
* Federated Runtime v1.0
experimental Aggregator and Collaborator in working condition
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added test, and mnist experimental workspaces working prototype
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Working on integration with Ishant's, and Keerti's code
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Second half of integration installment.
Remaning:
Integration of data.yaml file.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removing unnecessary directory my_federation.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* 1. Removed unncessart files.
2. Fix `fx plan freeze` command not working issue.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added function for test workspace
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added include_exclude testcase workspace.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Default execution workspace is mnist.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* data.yaml changes are integrated with this update.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Running a federation with GaNDLF Documentation (#794)
* Initial commit of Running the federation with GaNDLF Documentation
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update README.md
Removed references to Intel's ownship, given it's now owned by the LF AI and Data.
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix Flake8 C419 for Ubuntu CI (#800)
C419 Unnecessary list comprehension passed to any()/all() prevents short-circuiting - rewrite as a generator
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update README.md
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix warnings and issues in docs (#825)
* Fix warnings and issues in docs
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
* fixup! Fix warnings and issues in docs
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
---------
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add Logo (#827)
* Add Logo
* Update README.md
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Change OpenFL documentation font to improve accessibility (#809)
This replaces the font of OpenFL documents with Intel One Mono font for low vision developers.
Known issues:
1. The text font within the images has not been changed.
2. Some icons that do not exist in the new font cannot be displayed properly.
Fixes securefederatedai#799
Co-authored-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Co-authored-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update unit tests to improve code coverage (#821)
* Update ci config
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add unit test for following files
- openfl/federated/plan/plan.py
- openfl/interface/aggregation_functions/core/adaptive_aggregation.py
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add some test cases for databases module
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Fix bugs for databases module unittest
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Update unit tests for component module
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Restore workflow config and update some comments
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Enable save_ test case.
Add yaml under test dir for unit test usage.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove plan to new dir.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove plan to new dir.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add aggregator start test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 2 aggregator test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 1 aggregator test case.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Format code.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Refactor code.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add collaborator start test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 1 collaborator test case.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Format with flake8
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove TODO comments
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
---------
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com>
Co-authored-by: Lei5 Chen <lei5.chen@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add PyTorch linear regression example (#808)
This adds a new tutorial example on distributing a linear regression task over OpenFL cluster.
The model is defined by Pytorch which is able to run over both cpu (by default) and gpu. The dataset is generated by make_regression from sklearn.datasets with pre-defined parameters.
Fixes #797
Co-authored-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* This prints out the hash of the CSR to disk for both the aggregator and (#813)
* This prints out the hash of the CSR to disk for both the aggregator and
collaborator. The user then compares and approves this hash with the
hash printed out of the file to validate the CSR. In addition, a warning
message is pritned if certify is run in silent mode.
Fixes securefederatedai#692
Signed-off-by: Grant Baker <grant.baker@intel.com>
* Refactor read_csr function to use get_csr_hash
Signed-off-by: Grant Baker <grant.baker@intel.com>
* Ask to check hashes before prompt
---------
Signed-off-by: Grant Baker <grant.baker@intel.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Improve workspace requirements import (#810)
Remove the dump_requirement_file operation in export_ method.
Fixes securefederatedai#767
Co-authored-by: Li, Qingqing <qingqing.li@intel.com>
Co-authored-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Issue 506 Added Example using FedProx (#818)
* created new ineractive_api dir to hold pytorch fedprox mnist example
corrected files
changed to FedProxOptimizer and ran set_old_weights for new FedProx Pytorch example
renamed FedProx notebook
used mode.parrameters() to get pytorch model weights
got weights using state_dict
changed old wieghts to list (for serialization) and fixed README
input wieghts before zero_grad
[Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api
This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.
Fixes: #506
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api
This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.
Fixes: securefederatedai#506
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* Update README.md
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* addressed comments by psfoley: corrected words in the jupyter notebook metadata and added a link to the FedProx paper in the README.
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
---------
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* [Bug: 768] FX CLI: Separate create, cert gen commands (#807)
This change separates existing command
"fx collaborator.py generate-cert-request" command into two
commands.
"fx collaborator create -n {NAME} -d {DATA_PATH: optional}".
"fx collaborator generate-cert-request -n {NAME}".
Fixes #768
Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add new tutorial example to OpenFL interactive API (#812)
* Add new tutorial example to OpenFL interactive API
This adds a new tutorial example on distributing a linear regression task over OpenFL cluster
The model is defined by scikit-learn which is able to run over both cpu (by default) and gpu. The dataset is 1-dimensional noisy data of sinusoid with pre-defined parameters.
Fixes #798
Co-authored-by: Beverly Klemme <beverly.klemme@intel.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Yi CAO <yi2.cao@intel.com>
* reduced requirements.txt in workspace
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
---------
Signed-off-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Co-authored-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* build(deps): bump tensorflow in /openfl-workspace/tf_cnn_histology (#776)
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* build(deps): bump tensorflow (#777)
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update GaNDLF repo location and test CI with master branch
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update GaNDLF repo location and test CI with master branch
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update GaNDLF repo location and test CI with master branch
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix documentation links. Change path names and templates for CI
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix paths
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix paths
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix breaking tests
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add compatible onnx version to requirements.txt file
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix wrong csv file name
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix wrong csv file name
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix wrong names in workflow file
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix wrong data path
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix lint in test_gandlf.py
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix lint errors
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Signed-off-by: Yi CAO <yi2.cao@intel.com>
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Co-authored-by: Prashant Shah <40899779+SprashAI@users.noreply.github.com>
Co-authored-by: akantak <aleksander.kantak@intel.com>
Co-authored-by: wangleflex <106506636+wangleflex@users.noreply.github.com>
Co-authored-by: He, Dan H <dan.h.he@intel.com>
Co-authored-by: xiaoranf <desolatefang@gmail.com>
Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com>
Co-authored-by: Lei5 Chen <lei5.chen@intel.com>
Co-authored-by: Beverly Klemme <35578090+bjklemme-intel@users.noreply.github.com>
Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Co-authored-by: Yi CAO <yi2.cao@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid (#841)
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fix GaNDLF documentation links (#842)
* Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix links in GaNDLF Documentation
* Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix links in GaNDLF Documentation
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fix incorrectly formatted link in docs (#839)
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added licensing information to all experimental workspaces
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Made changes to LocalRuntime, and tested
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Rename collaborator_name variable to name in
experimental/component/collaborator/collaborator.py file.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump onnx in /openfl-workspace/gandlf_seg_test (#840)
Bumps [onnx](https://github.com/onnx/onnx) from 1.12 to 1.13.0.
- [Release notes](https://github.com/onnx/onnx/releases)
- [Changelog](https://github.com/onnx/onnx/blob/main/docs/Changelog.md)
- [Commits](https://github.com/onnx/onnx/compare/v1.12.0...v1.13.0)
---
updated-dependencies:
- dependency-name: onnx
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Selected collaborators functionality added, test workspace of the same
is work-progress.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Selected collaborator testcases included with this commit.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Testcase private attributes workspace added with this commit.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Instead of remove private attributes from checkpoint, changed the value
to string "Private attributes: Not Available."
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added / Modified types of funciton arguments, and their return types.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Aggregator shutdown related changes are done in this commit
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update testflow_subset_of_collaborators.py
Updated subset of collaborators testcase
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified subset of collaborators testcase.
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Add files via upload
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Accessibility updates (#861)
* Fix incorrectly formatted link in docs
Signed-off-by: Francis Storr <francis.storr@intel.com>
* Font styling, color contrast, other accessibility updates
This update:
1. Restores Roboto and Lato fonts for most body copy, leaving Intel One Mono for code samples.
2. Adds colors (in `colors.css`)
3. Adds a new `accessibility_overrides.css` file containing CSS that improves the accessibility of the documentation and, where possible, Read The Docs. These updates remediate numerous non-conforming WCAG 2.x Level AA bugs. The use of a separate file for this hopefully makes these changes easier to manage and less likely to be accessibility overwritten in the future.
Closes #848
Signed-off-by: Francis Storr <francis.storr@intel.com>
---------
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_nlp (#773)
* build(deps): bump tensorflow in /openfl-workspace/keras_nlp
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update RMSProp optimizer import
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* flake8
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_cnn_mnist (#771)
* build(deps): bump tensorflow in /openfl-workspace/keras_cnn_mnist
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* revert experimental Adam to legacy (#863)
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: kta-intel <kevin.ta@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_cnn_with_compression (#770)
* build(deps): bump tensorflow
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update Adam Optimizer import
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.9.3 to 2.11.1 in /openfl-tutorials/interactive_api/Flax_CNN_CIFAR (#775)
* build(deps): bump tensorflow
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* Fixed breaking backages
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add quiet flag back to pip install
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow-cpu from 2.8.4 to 2.11.1 in /openfl-workspace/keras_nlp_gramine_ready (#769)
* build(deps): bump tensorflow-cpu
Bumps [tensorflow-cpu](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow-cpu
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* Use legacy RMSprop optimizer
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Accessibility color contrast fixes (#864)
* Fix incorrectly formatted link in docs
Signed-off-by: Francis Storr <francis.storr@intel.com>
* Font styling, color contrast, other accessibility updates
This update:
1. Restores Roboto and Lato fonts for most body copy, leaving Intel One Mono for code samples.
2. Adds colors (in `colors.css`)
3. Adds a new `accessibility_overrides.css` file containing CSS that improves the accessibility of the documentation and, where possible, Read The Docs. These updates remediate numerous non-conforming WCAG 2.x Level AA bugs. The use of a separate file for this hopefully makes these changes easier to manage and less likely to be accessibility overwritten in the future.
Closes #848
Signed-off-by: Francis Storr <francis.storr@intel.com>
* Color contrast updates for accessibility
Color contrast updates for accessibility
- update generic `a` element
- update color of links in the toggle-able read-the-docs panel
- update the color of the text in search results
- update the color of notes headers
Signed-off-by: Francis Storr <francis.storr@intel.com>
---------
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Testflow for verifying stdout redirection to Metaflow datastore (#758)
* implemented ray.wait
* reverted changes back after testing
* adding datastore cli test case
* removed unused variables
* removed stderr validation
* fixed lint suggestions
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Tweak link color so it’s not so aggressive (#865)
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* External Loop Functionality Added
External Loop Functionality Added
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* External Loop Functionality Added
External Loop Functionality Added
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* External Loop Functionality Added
External Loop Functionality Added
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added following tutorials, and testcase:
1. Vertical FL
2. Vertical FL Two Party
3. Internal Loop
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* plan.yaml modified in 301 watermarking, and subset of collaborators.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modifying temp.sh for 2 collaborators.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update aggregator.py
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* FQDN switched to localhost
FQDN switched to localhost
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* While activating experimental OpenFL commands, install depedencies as well.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Install experimental requirements while activating experimental openfl commands.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update experimental-requirements.txt
Added ray 2.2.0 to experimental-requirements.txt file
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update requirements_workflow_interface.txt
Metaflow, and Ray dependencies are moved to openfl-workspace/experimental/experimental-requrirements.txt file.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Delete openfl/experimental/utilities/utils.py, and removed torch depency from openfl/experimental/utilities/resources.py
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update requirements_workflow_interface.txt
Updated experimental tutorials requirements.txt file
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updating 201 GPUs tutorial
Updated Workflow_Interface_201_Exclusive_GPUs_with_Ray.ipynb for Aggregator, and Collaborator as stateful actor
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified 101, 102, 103, 301, 401 tutorials as per Aggregator, & Collaborator stateful collaborators
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Excluding 'experimental' directory from workspace templates
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update 101 tutorial data.yaml
Updated 101 tutorials data.yaml to correct a mistake by in index parameter of private attribute function.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update resources.py
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified get_number_of_gpus function
Modify get_number_of_gpus function
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* This commit brings following changes:
1. Removed torch dependency from "get_number_of_gpus"
2. Added keras mnist example notebook
3. Added keras mnist workspace example
4. Removed openfl-workspace/experimental/experimental-requirements.txt
5. "fx aggregator start" command will install libraries from experimental tutorials requirements_workflow_interface.txt file
6. Added testcase_datastore_cli, testcase_reference and testcase_reference_with_include_exclude
7. Updated 101 torch mnist plan.yaml and data.yaml
8. Removed aggregator start flow thread from cli/aggregator.py
9. At last changes made in federated runtime
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /tests/github/interactive_api_director/experiments/tensorflow_mnist/envoy (#772)
* build(deps): bump tensorflow
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* Update sd_requirements.txt
* revert to legacy SGD and install tensorflow==2.11 for workflow
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: kta-intel <kevin.ta@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <patrick.foley@intel.com>
Co-authored-by: kta-intel <kevin.ta@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/tf_2dunet (#774)
* build(deps): bump tensorflow in /openfl-workspace/tf_2dunet
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* Update requirements.txt
to retrigger CI
* Update requirements.txt
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* This commit brings following changes:
1. Renamed Workflow_Interface_101_Keras_MNIST_with_GPU.ipynb to Workflow_Interface_104_Keras_MNIST_with_GPU.ipynb
2. Updated documentation in Workflow_Interface_104_Keras_MNIST_with_GPU.ipynb
3. protobuf bumped from 3.19.6 to 3.20.0 in setup.py
4. Incorporating review comments (WIP)
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified 104 Keras MNIST tutorial
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* This comming brings following changes:
1. Experimental Aggregator workflow testcases moved to test/github/experimental/workspace directory
2. Added dependecy related changes
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removing unnecessary logs
Removing unnecessary logs
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update collaborator.py
Removing unnecessary logs
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Avoided deep copying the context by removing private attributes from context before checkpoint
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Incoporated review comments
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added dependecies to each tutorial notebooks
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* pinned tensorboardX (#870)
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* While taking aggregator step remove private attributes before taking checkpoint and set it back to ctx after checkpoint
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removing unnecessary deepcopies from aggregator.py file
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removing unnecessary comments
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update stream_redirect.py
Removing unnecessary imports
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added color escape sequences to datastore cli localruntime and workspace testcases
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update requirements_privacy_meter.txt
torch 1.13.1 requires torchvision 0.14.1 not 0.14.0
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update Workflow_Interface_VFL_Two_Party
Added actor related changed to Workflow_Interface_VFL_Two_Party
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Files added required to test experimental aggregator based workflow by GitHUB actions
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update Workflow_Interface_104_Keras_MNIST_with_GPU.ipynb
Removing GPU parameter from collaborator decorator.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update resources.py
Updated get_number_of_gpus function
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updating import statement
In 104 keras workspace utils.py updating import SummaryWriter statement from torch to tensorflow
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* With this commit path of template can be explicitely given, user does not have to
choose from available example templates. Only applicable to experimental openfl.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fixed flake8 issues and typos
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolved flake8 issues,
Added warning statements when data.yaml is not found or aggregator / collaborator private attributes are not found in data.yaml,
Tested by running all tutorials and tests
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Moving the logs after data.yaml warning, and removing unnecessary blank lines.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Adding N-level arguments functionality
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update workflow_interface.rst
Added section on how to save best and last model from Metaflow CLI
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolving last few TODO items.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated logs to provide exact information to user.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* This commit brings following updates:
1. Remove unnecessary spaces from Workflow_Interface_102_Aggregator_Validation.ipynb
2. Upgraded protobuf to 3.20.3 in setup.py as per tensorboard requirements
3. Modified 101-torch-cnn-mnist workspace for n-level arguments
4. Added a federated runtime workspace for 102-aggregator-validation
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* This commit brings following changes:
1. Added 501_pytorch_tinyimagenet_transfer_learning workspace for experimental workflow interface
2. Removed `feature_shape` from openfl/experimental/interface/cli/plan.py
3. Resolved flake8 errors in openfl-workspace/experimental directory
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update data.yaml
Correcting a mistake train dataset assigned to test and vice versa.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update flow.py
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update flow.py
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Adding functionality to convert jupyter notebook to workspace (in progress)
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Write flow.py, collaborator_private_attrs.py and aggregator_private_attrs.py automatically
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Find aggregator, and collaborator arguments
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modifying arguments help
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removed automatically generated Zone.Identifier file
Added Approach2 notebook
Modified creator.py
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* workspace_creator renamed to workspace_builder
finding values without help of any tags
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Finished exporting data.yaml, plan.yaml.
Workspace creator validated for 101 MNIST and 301 Watermarking with MNIST
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removing round number constant argument from 301 MNIST WATERMARKING
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* * Created get_collaborator_kwargs function in localruntime class which takes collaborator name as argument and returns name of private attributes function and arguments required to call it.
* Changed workspace builder code used get_collaborator_kwargs function to build data.yaml file.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified get_collaborator_args function
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified workspace_builder/build.py file to resolve a typo
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removed unnecessary files from template_workspace directory
Moved print_tree to after generating python script
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added documentation and inline comments for workspace_builder
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added libraries required by WorkspaceBuilder
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update Tensorflow, gRPC, Protobuf dependencies (#868)
* Update Tensorflow to latest, finally update grpcio/protobuf
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Lint issue fix and missing tf reference
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* pyzmq version fixed
* fix taskrunner tests for windows
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* fix taskrunner test syntax for windows
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* adding user option to workspace pip install requirements for windows
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* fix windows CI test
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* testing virtual env for windows github actions
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* testing virtual env for windows github actions
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* testing virtual env for windows github actions
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* testing venv for windows
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* test venv for windows
* test venv for windows
* Added new KerasSerializer. Fixed other Interactive API experiments
* Update taskrunner.yml
* Update taskrunner.yml
* Update workspace.py
* Update workspace.py
* Update taskrunner.yml
* Remove get_model import from global namespace so dependencies are not loaded into memory unnecessarily (breaking windows build)
* Refactoring and cleaning up imports to support Windows install
* Fixed logger import paths
* Fix missing imports
* Fix native import
* Fix lint errors
* Fix keras optimizer patch. Remove irrelevant unit test
* Format logs in UTF-8 for windows
* Update interactive-kvasir.yml
* Consolidate github actions python versions to single file
* Update python versions
* Update python versions
* Update python versions
* Reduce # of DataLoader workers for Pytorch Kvasir CI test
* Fix Windows encoding
* Fix Windows encoding and limit rounds so Github Actions CI doesn't run out of memory
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix windows encoding
* Fix Windows encoding
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
Co-authored-by: Mansi Sharma <77758170+mansishr@users.noreply.github.com>
Co-authored-by: Mansi Sharma <mansi.sharma@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Add FL plan description to documentation (#872)
* Add plan description to documentation
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* fix indentation
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* Apply suggestions from code review
Co-authored-by: Patrick Foley <patrick.foley@intel.com>
---------
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
Co-authored-by: Patrick Foley <patrick.foley@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolve Coverity Issues (#874)
* Fix coverity issues
* Resolve remaining coverity issues
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Migrate to Ubuntu 22.04 LTS release (supported through 2027) (#875)
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fixed flake8 issues
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fixed flake8 issues in test/experimental directory
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Accessibility updates (#861)
* Fix incorrectly formatted link in docs
Signed-off-by: Francis Storr <francis.storr@intel.com>
* Font styling, color contrast, other accessibility updates
This update:
1. Restores Roboto and Lato fonts for most body copy, leaving Intel One Mono for code samples.
2. Adds colors (in `colors.css`)
3. Adds a new `accessibility_overrides.css` file containing CSS that improves the accessibility of the documentation and, where possible, Read The Docs. These updates remediate numerous non-conforming WCAG 2.x Level AA bugs. The use of a separate file for this hopefully makes these changes easier to manage and less likely to be accessibility overwritten in the future.
Closes #848
Signed-off-by: Francis Storr <francis.storr@intel.com>
---------
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* fixing FedAvg in workflow interface tutorials to be compatible with latest numpy stable release (1.24.3) (#833)
* fixing FedAvg averaging in order to be compatible with numpy v1.24+
Signed-off-by: kta-intel <kevin.ta@intel.com>
* uncommenting installations for consistency with other tutorials
Signed-off-by: kta-intel <kevin.ta@intel.com>
* fixing 301_MNIST_Watermarking tutorial FedAvg
Signed-off-by: kta-intel <kevin.ta@intel.com>
* fixing 301_MNIST_Watermarki
ng tutorial FedAvg
Signed-off-by: kta-intel <kevin.ta@intel.com>
* Switching to py38 kernel and clearing cell outputs
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: kta-intel <kevin.ta@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Testflow for verifying stdout redirection to Metaflow datastore (#758)
* implemented ray.wait
* reverted changes back after testing
* adding datastore cli test case
* removed unused variables
* removed stderr validation
* fixed lint suggestions
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolving DCO issue
fixing FedAvg in workflow interface tutorials to be compatible with latest numpy stable release (1.24.3) (#833)
* fixing FedAvg averaging in order to be compatible with numpy v1.24+
Signed-off-by: kta-intel <kevin.ta@intel.com>
* uncommenting installations for consistency with other tutorials
Signed-off-by: kta-intel <kevin.ta@intel.com>
* fixing 301_MNIST_Watermarking tutorial FedAvg
Signed-off-by: kta-intel <kevin.ta@intel.com>
* fixing 301_MNIST_Watermarki
ng tutorial FedAvg
Signed-off-by: kta-intel <kevin.ta@intel.com>
* Switching to py38 kernel and clearing cell outputs
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: kta-intel <kevin.ta@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update EdenPipeline in the documentation (#877)
Signed-off-by: Amit Portnoy <1131991+amitport@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fixed flake8 issues
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added weighted_average aggregation function under openfl.experimental.interface.{keras,torch}.aggregation_funtions
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Tested all local-runtime & federated-runtime tutorials and testcases
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolving merge conflicts in experimental local-runtme tutorials 101, 103, 201, & 301
fixing FedAvg in workflow interface tutorials to be compatible with latest numpy stable release (1.24.3) (#833)
* fixing FedAvg averaging in order to be compatible with numpy v1.24+
Signed-off-by: kta-intel <kevin.ta@intel.com>
* uncommenting installations for consistency with other tutorials
Signed-off-by: kta-intel <kevin.ta@intel.com>
* fixing 301_MNIST_Watermarking tutorial FedAvg
Signed-off-by: kta-intel <kevin.ta@intel.com>
* fixing 301_MNIST_Watermarki
ng tutorial FedAvg
Signed-off-by: kta-intel <kevin.ta@intel.com>
* Switching to py38 kernel and clearing cell outputs
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* WIP: CI Scans (#873)
* Initial scans commit for bandit, hadolint, trivy
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Address bandit scan results
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix Trivy action
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix linting
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add Coverity Badge
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update Hadolint threshold to flag errors only
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update Hadolint threshold to flag errors only
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update ROADMAP.md (#878)
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* This commit brings following changes:
1. Renaming workspace_builder module to workspace_export.
2. WorkspaceBuilder class renamed to WorkspaceExport.
3. Added WorkspaceExport.export function for user which wraps generate_requirements, generate_plan_yaml, generate_data_yaml functions.
4. Merged WorkspaceExport module to `fx workspace create` command by adding new following arguments:
- `--notebook` Path to jupyter notebook
- `--template_workspace_dir` Output path for generated workspace
5. WorkspaceExport removed from 101, and 103 tutorials.
6. setup.py changed accordingly.
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* This commit brings following changes:
1. output_dir renamed to output_workspace also the user must pass this parameter
(default=/tmp is now removed) or there will be an error.
2. template_workspace_path is not required anymore.
3. Added a new tutorials Workflow_Interface_1001_Workspace_Creation_from_JupyterNotebook.ipynb
(copy of Workflow_Interface_301_MNIST_Watermarking.ipynb) explaining how to use WorkspaceExport.
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* In Workflow_Interface_1001 tutorial list of collaborator are changed to 5 from 2
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Uncommeted pip install libraries
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Adding GPU for aggregator in 201, Global DP & Privacy Meter tutorials
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modifed documentation in 1001 tutorial
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified documentation in 1001 tutorial
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fixing 'param' attribute not found issue. in 301, 1001 experimental tutrials and 301
mnist watermarking workspace.
Sol.
imagen library installs param depedency latest version
and param package got an upgrde recently. Pinned param to 1.13.0
after installing imagen which fixed the issue.
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* VFL 2 party example
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* participant names to lowercase and changes to instructions
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* Resolving missing packages from watermarking examples that break python 3.9+. Fix linting, spelling. Remove experimental aggregation functions
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Remove duplicate files in openfl.experimental
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Trigger CI
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Moving test to be conditional
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix inconsistent use of enumerate in loops
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fixing tests
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Accomodate conversion of names to lower case
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Missing torchvision dependency in tests
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix lint issues
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Signed-off-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: kta-intel <kevin.ta@intel.com>
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
Signed-off-by: Amit Portnoy <1131991+amitport@users.noreply.github.com>
Co-authored-by: Patrick Foley <patrick.foley@intel.com>
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Co-authored-by: Prashant Shah <40899779+SprashAI@users.noreply.github.com>
Co-authored-by: akantak <aleksander.kantak@intel.com>
Co-authored-by: wangleflex <106506636+wangleflex@users.noreply.github.com>
Co-authored-by: He, Dan H <dan.h.he@intel.com>
Co-authored-by: xiaoranf <desolatefang@gmail.com>
Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com>
Co-authored-by: Lei5 Chen <lei5.chen@intel.com>
Co-authored-by: Beverly Klemme <35578090+bjklemme-intel@users.noreply.github.com>
Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Co-authored-by: Yi CAO <yi2.cao@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Francis Storr <francis.storr@intel.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com>
Co-authored-by: Keerti Prakash Talwar <115972088+KeertiX@users.noreply.github.com>
Co-authored-by: kta-intel <kevin.ta@intel.com>
Co-authored-by: porteratzo <44075849+porteratzo@users.noreply.github.com>
Co-authored-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Co-authored-by: Mansi Sharma <77758170+mansishr@users.noreply.github.com>
Co-authored-by: Mansi Sharma <mansi.sharma@intel.com>
Co-authored-by: Amit Portnoy <1131991+amitport@users.noreply.github.com>
manuelhsantana
pushed a commit
that referenced
this pull request
Jul 10, 2024
* Fix flake8 error in local runtime (#764)
* Removes unnecessary dict comprehension
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Removes unnecessary dict comprehension
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update ROADMAP.md (#765)
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update README.md
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update GOVERNANCE.md
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update ROADMAP.md (#785)
Typos
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated integrations to GaNDLF (#781)
* renaming loader and runner
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
* updated plan to pick the new names
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
* new key name
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
* allow the ability to pass a file to `gandlf_config_dict` in addition to fully-fledged parameters
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
* checking this differently
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
* rename variable for clarity
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
---------
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update README.md
Removed references to Intel's ownship, given it's now owned by the LF AI and Data.
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fix Flake8 C419 for Ubuntu CI (#800)
C419 Unnecessary list comprehension passed to any()/all() prevents short-circuiting - rewrite as a generator
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Introduced shard descriptor based collaborator private attributes
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Adding batch size for train, and test in config.yaml file
Files modified:
1. config.yaml
2. mnist_shard_descriptor.py
3. Workflow_Interface_101_MNIST.ipynb
4. participants.py
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Introducing multiple config yaml files
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removing unnecessary config.yaml file.
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added collaborator private atribute delayed initialization
for local_runtime
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Incorporated review comments
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added multi-pricessing ray backend support and, aggregator yaml file
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated multi-processing code
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* RayExecutor class moved from participants.py to localruntime.py
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* RayExecytor moved from interface/pariticipants.py to
runtime/local_runtime.py
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added Aggregator private attribute initialation in runtime
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removed unnecessary import statements
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Code cleaned up, validated checkpoints manually
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Refactored, and added some new doc string
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolved Flake8 instructions
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Recusrsion removal + Serialization removal integrated
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Incoporated Review Comments
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removed configuration YAML files, and
added functionality to initialize private attributes by calling a
callback function created by end-user
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removed commented code
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Implemented new approach, two example files given
1. Workflow_Interface_101_MNIST.py
2. Workflow_Interface_301_MNIST_Watermarking.py
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Internal Review Comments Incorporated
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* No private attributes are required
If private attributes are not provided, by default take an empty dictionary no need to pass a callable function.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update participants.py
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added a check for GPU Resource Allocation
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified error message for resource allocation
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolved bug found during testing phase
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modifide all the test cases, and following tutorials
1. Privacy Meter
2. FedProx
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added following test cases:
1. Workflow_Interface_101_MNIST.ipynb
2. Workflow_Interface_102_Aggregator_Validation.ipynb
3. Workflow_Interface_301_MNIST_Watermarking.ipynb
4. Workflow_Interface_201_Exclusive_GPUs_with_Ray.ipynb
5. Workflow_Interface_103_Cyclic_Institutional_Incremental_Learning.ipynb
Signed-off-by: Parth Mandaliya <Parthx.Mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified and Added Global_DP tutorials.
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified and Added tutorial Workflow-Interface_201_Exclusive_GPUs_with_Ray.ipynb
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified documentation for Workflow_Interface_201 tutorial.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* fixed flake-8 errors
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* reverted import module code
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolved merge conflicts in local_runtime.py
---------
Fix flake8 error in local runtime (#764)
* Removes unnecessary dict comprehension
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Removes unnecessary dict comprehension
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update README.md
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fix warnings and issues in docs (#825)
* Fix warnings and issues in docs
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
* fixup! Fix warnings and issues in docs
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
---------
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Add Logo (#827)
* Add Logo
* Update README.md
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Change OpenFL documentation font to improve accessibility (#809)
This replaces the font of OpenFL documents with Intel One Mono font for low vision developers.
Known issues:
1. The text font within the images has not been changed.
2. Some icons that do not exist in the new font cannot be displayed properly.
Fixes securefederatedai#799
Co-authored-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Co-authored-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update unit tests to improve code coverage (#821)
* Update ci config
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add unit test for following files
- openfl/federated/plan/plan.py
- openfl/interface/aggregation_functions/core/adaptive_aggregation.py
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add some test cases for databases module
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Fix bugs for databases module unittest
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Update unit tests for component module
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Restore workflow config and update some comments
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Enable save_ test case.
Add yaml under test dir for unit test usage.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove plan to new dir.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove plan to new dir.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add aggregator start test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 2 aggregator test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 1 aggregator test case.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Format code.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Refactor code.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add collaborator start test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 1 collaborator test case.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Format with flake8
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove TODO comments
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
---------
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com>
Co-authored-by: Lei5 Chen <lei5.chen@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Add PyTorch linear regression example (#808)
This adds a new tutorial example on distributing a linear regression task over OpenFL cluster.
The model is defined by Pytorch which is able to run over both cpu (by default) and gpu. The dataset is generated by make_regression from sklearn.datasets with pre-defined parameters.
Fixes #797
Co-authored-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* This prints out the hash of the CSR to disk for both the aggregator and (#813)
* This prints out the hash of the CSR to disk for both the aggregator and
collaborator. The user then compares and approves this hash with the
hash printed out of the file to validate the CSR. In addition, a warning
message is pritned if certify is run in silent mode.
Fixes securefederatedai#692
Signed-off-by: Grant Baker <grant.baker@intel.com>
* Refactor read_csr function to use get_csr_hash
Signed-off-by: Grant Baker <grant.baker@intel.com>
* Ask to check hashes before prompt
---------
Signed-off-by: Grant Baker <grant.baker@intel.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Improve workspace requirements import (#810)
Remove the dump_requirement_file operation in export_ method.
Fixes securefederatedai#767
Co-authored-by: Li, Qingqing <qingqing.li@intel.com>
Co-authored-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Issue 506 Added Example using FedProx (#818)
* created new ineractive_api dir to hold pytorch fedprox mnist example
corrected files
changed to FedProxOptimizer and ran set_old_weights for new FedProx Pytorch example
renamed FedProx notebook
used mode.parrameters() to get pytorch model weights
got weights using state_dict
changed old wieghts to list (for serialization) and fixed README
input wieghts before zero_grad
[Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api
This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.
Fixes: #506
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api
This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.
Fixes: securefederatedai#506
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* Update README.md
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* addressed comments by psfoley: corrected words in the jupyter notebook metadata and added a link to the FedProx paper in the README.
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
---------
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* [Bug: 768] FX CLI: Separate create, cert gen commands (#807)
This change separates existing command
"fx collaborator.py generate-cert-request" command into two
commands.
"fx collaborator create -n {NAME} -d {DATA_PATH: optional}".
"fx collaborator generate-cert-request -n {NAME}".
Fixes #768
Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Add new tutorial example to OpenFL interactive API (#812)
* Add new tutorial example to OpenFL interactive API
This adds a new tutorial example on distributing a linear regression task over OpenFL cluster
The model is defined by scikit-learn which is able to run over both cpu (by default) and gpu. The dataset is 1-dimensional noisy data of sinusoid with pre-defined parameters.
Fixes #798
Co-authored-by: Beverly Klemme <beverly.klemme@intel.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Yi CAO <yi2.cao@intel.com>
* reduced requirements.txt in workspace
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
---------
Signed-off-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Co-authored-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow in /openfl-workspace/tf_cnn_histology (#776)
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow (#777)
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Running a federation with GaNDLF Documentation (#794)
* Initial commit of Running the federation with GaNDLF Documentation
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update README.md
Removed references to Intel's ownship, given it's now owned by the LF AI and Data.
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix Flake8 C419 for Ubuntu CI (#800)
C419 Unnecessary list comprehension passed to any()/all() prevents short-circuiting - rewrite as a generator
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update README.md
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix warnings and issues in docs (#825)
* Fix warnings and issues in docs
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
* fixup! Fix warnings and issues in docs
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
---------
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add Logo (#827)
* Add Logo
* Update README.md
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Change OpenFL documentation font to improve accessibility (#809)
This replaces the font of OpenFL documents with Intel One Mono font for low vision developers.
Known issues:
1. The text font within the images has not been changed.
2. Some icons that do not exist in the new font cannot be displayed properly.
Fixes securefederatedai#799
Co-authored-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Co-authored-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update unit tests to improve code coverage (#821)
* Update ci config
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add unit test for following files
- openfl/federated/plan/plan.py
- openfl/interface/aggregation_functions/core/adaptive_aggregation.py
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add some test cases for databases module
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Fix bugs for databases module unittest
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Update unit tests for component module
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Restore workflow config and update some comments
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Enable save_ test case.
Add yaml under test dir for unit test usage.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove plan to new dir.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove plan to new dir.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add aggregator start test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 2 aggregator test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 1 aggregator test case.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Format code.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Refactor code.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add collaborator start test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 1 collaborator test case.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Format with flake8
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove TODO comments
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
---------
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com>
Co-authored-by: Lei5 Chen <lei5.chen@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add PyTorch linear regression example (#808)
This adds a new tutorial example on distributing a linear regression task over OpenFL cluster.
The model is defined by Pytorch which is able to run over both cpu (by default) and gpu. The dataset is generated by make_regression from sklearn.datasets with pre-defined parameters.
Fixes #797
Co-authored-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* This prints out the hash of the CSR to disk for both the aggregator and (#813)
* This prints out the hash of the CSR to disk for both the aggregator and
collaborator. The user then compares and approves this hash with the
hash printed out of the file to validate the CSR. In addition, a warning
message is pritned if certify is run in silent mode.
Fixes securefederatedai#692
Signed-off-by: Grant Baker <grant.baker@intel.com>
* Refactor read_csr function to use get_csr_hash
Signed-off-by: Grant Baker <grant.baker@intel.com>
* Ask to check hashes before prompt
---------
Signed-off-by: Grant Baker <grant.baker@intel.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Improve workspace requirements import (#810)
Remove the dump_requirement_file operation in export_ method.
Fixes securefederatedai#767
Co-authored-by: Li, Qingqing <qingqing.li@intel.com>
Co-authored-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Issue 506 Added Example using FedProx (#818)
* created new ineractive_api dir to hold pytorch fedprox mnist example
corrected files
changed to FedProxOptimizer and ran set_old_weights for new FedProx Pytorch example
renamed FedProx notebook
used mode.parrameters() to get pytorch model weights
got weights using state_dict
changed old wieghts to list (for serialization) and fixed README
input wieghts before zero_grad
[Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api
This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.
Fixes: #506
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api
This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.
Fixes: securefederatedai#506
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* Update README.md
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* addressed comments by psfoley: corrected words in the jupyter notebook metadata and added a link to the FedProx paper in the README.
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
---------
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* [Bug: 768] FX CLI: Separate create, cert gen commands (#807)
This change separates existing command
"fx collaborator.py generate-cert-request" command into two
commands.
"fx collaborator create -n {NAME} -d {DATA_PATH: optional}".
"fx collaborator generate-cert-request -n {NAME}".
Fixes #768
Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add new tutorial example to OpenFL interactive API (#812)
* Add new tutorial example to OpenFL interactive API
This adds a new tutorial example on distributing a linear regression task over OpenFL cluster
The model is defined by scikit-learn which is able to run over both cpu (by default) and gpu. The dataset is 1-dimensional noisy data of sinusoid with pre-defined parameters.
Fixes #798
Co-authored-by: Beverly Klemme <beverly.klemme@intel.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Yi CAO <yi2.cao@intel.com>
* reduced requirements.txt in workspace
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
---------
Signed-off-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Co-authored-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* build(deps): bump tensorflow in /openfl-workspace/tf_cnn_histology (#776)
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* build(deps): bump tensorflow (#777)
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update GaNDLF repo location and test CI with master branch
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update GaNDLF repo location and test CI with master branch
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update GaNDLF repo location and test CI with master branch
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix documentation links. Change path names and templates for CI
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix paths
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix paths
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix breaking tests
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add compatible onnx version to requirements.txt file
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix wrong csv file name
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix wrong csv file name
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix wrong names in workflow file
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix wrong data path
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix lint in test_gandlf.py
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix lint errors
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Signed-off-by: Yi CAO <yi2.cao@intel.com>
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Co-authored-by: Prashant Shah <40899779+SprashAI@users.noreply.github.com>
Co-authored-by: akantak <aleksander.kantak@intel.com>
Co-authored-by: wangleflex <106506636+wangleflex@users.noreply.github.com>
Co-authored-by: He, Dan H <dan.h.he@intel.com>
Co-authored-by: xiaoranf <desolatefang@gmail.com>
Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com>
Co-authored-by: Lei5 Chen <lei5.chen@intel.com>
Co-authored-by: Beverly Klemme <35578090+bjklemme-intel@users.noreply.github.com>
Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Co-authored-by: Yi CAO <yi2.cao@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid (#841)
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fix GaNDLF documentation links (#842)
* Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix links in GaNDLF Documentation
* Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix links in GaNDLF Documentation
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fix incorrectly formatted link in docs (#839)
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolving merge conflicts in local-runtime.py
Integrated aggregator as stateful actor branch, tested.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
--------
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump onnx in /openfl-workspace/gandlf_seg_test (#840)
Bumps [onnx](https://github.com/onnx/onnx) from 1.12 to 1.13.0.
- [Release notes](https://github.com/onnx/onnx/releases)
- [Changelog](https://github.com/onnx/onnx/blob/main/docs/Changelog.md)
- [Commits](https://github.com/onnx/onnx/compare/v1.12.0...v1.13.0)
---
updated-dependencies:
- dependency-name: onnx
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Merged changes of remove-torch-dependency branch
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update setup.py
Upgrading protobuf to 3.20.3 as per tensorboard requirement
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolving merge conflicts
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Accessibility updates (#861)
* Fix incorrectly formatted link in docs
Signed-off-by: Francis Storr <francis.storr@intel.com>
* Font styling, color contrast, other accessibility updates
This update:
1. Restores Roboto and Lato fonts for most body copy, leaving Intel One Mono for code samples.
2. Adds colors (in `colors.css`)
3. Adds a new `accessibility_overrides.css` file containing CSS that improves the accessibility of the documentation and, where possible, Read The Docs. These updates remediate numerous non-conforming WCAG 2.x Level AA bugs. The use of a separate file for this hopefully makes these changes easier to manage and less likely to be accessibility overwritten in the future.
Closes #848
Signed-off-by: Francis Storr <francis.storr@intel.com>
---------
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_nlp (#773)
* build(deps): bump tensorflow in /openfl-workspace/keras_nlp
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update RMSProp optimizer import
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* flake8
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_cnn_mnist (#771)
* build(deps): bump tensorflow in /openfl-workspace/keras_cnn_mnist
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* revert experimental Adam to legacy (#863)
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: kta-intel <kevin.ta@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_cnn_with_compression (#770)
* build(deps): bump tensorflow
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update Adam Optimizer import
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.9.3 to 2.11.1 in /openfl-tutorials/interactive_api/Flax_CNN_CIFAR (#775)
* build(deps): bump tensorflow
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* Fixed breaking backages
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add quiet flag back to pip install
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow-cpu from 2.8.4 to 2.11.1 in /openfl-workspace/keras_nlp_gramine_ready (#769)
* build(deps): bump tensorflow-cpu
Bumps [tensorflow-cpu](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow-cpu
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* Use legacy RMSprop optimizer
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Accessibility color contrast fixes (#864)
* Fix incorrectly formatted link in docs
Signed-off-by: Francis Storr <francis.storr@intel.com>
* Font styling, color contrast, other accessibility updates
This update:
1. Restores Roboto and Lato fonts for most body copy, leaving Intel One Mono for code samples.
2. Adds colors (in `colors.css`)
3. Adds a new `accessibility_overrides.css` file containing CSS that improves the accessibility of the documentation and, where possible, Read The Docs. These updates remediate numerous non-conforming WCAG 2.x Level AA bugs. The use of a separate file for this hopefully makes these changes easier to manage and less likely to be accessibility overwritten in the future.
Closes #848
Signed-off-by: Francis Storr <francis.storr@intel.com>
* Color contrast updates for accessibility
Color contrast updates for accessibility
- update generic `a` element
- update color of links in the toggle-able read-the-docs panel
- update the color of the text in search results
- update the color of notes headers
Signed-off-by: Francis Storr <francis.storr@intel.com>
---------
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Tweak link color so it’s not so aggressive (#865)
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /tests/github/interactive_api_director/experiments/tensorflow_mnist/envoy (#772)
* build(deps): bump tensorflow
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* Update sd_requirements.txt
* revert to legacy SGD and install tensorflow==2.11 for workflow
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: kta-intel <kevin.ta@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <patrick.foley@intel.com>
Co-authored-by: kta-intel <kevin.ta@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/tf_2dunet (#774)
* build(deps): bump tensorflow in /openfl-workspace/tf_2dunet
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* Update requirements.txt
to retrigger CI
* Update requirements.txt
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update Tensorflow, gRPC, Protobuf dependencies (#868)
* Update Tensorflow to latest, finally update grpcio/protobuf
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Lint issue fix and missing tf reference
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* pyzmq version fixed
* fix taskrunner tests for windows
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* fix taskrunner test syntax for windows
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* adding user option to workspace pip install requirements for windows
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* fix windows CI test
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* testing virtual env for windows github actions
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* testing virtual env for windows github actions
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* testing virtual env for windows github actions
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* testing venv for windows
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* test venv for windows
* test venv for windows
* Added new KerasSerializer. Fixed other Interactive API experiments
* Update taskrunner.yml
* Update taskrunner.yml
* Update workspace.py
* Update workspace.py
* Update taskrunner.yml
* Remove get_model import from global namespace so dependencies are not loaded into memory unnecessarily (breaking windows build)
* Refactoring and cleaning up imports to support Windows install
* Fixed logger import paths
* Fix missing imports
* Fix native import
* Fix lint errors
* Fix keras optimizer patch. Remove irrelevant unit test
* Format logs in UTF-8 for windows
* Update interactive-kvasir.yml
* Consolidate github actions python versions to single file
* Update python versions
* Update python versions
* Update python versions
* Reduce # of DataLoader workers for Pytorch Kvasir CI test
* Fix Windows encoding
* Fix Windows encoding and limit rounds so Github Actions CI doesn't run out of memory
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix windows encoding
* Fix Windows encoding
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
Co-authored-by: Mansi Sharma <77758170+mansishr@users.noreply.github.com>
Co-authored-by: Mansi Sharma <mansi.sharma@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Add FL plan description to documentation (#872)
* Add plan description to documentation
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* fix indentation
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* Apply suggestions from code review
Co-authored-by: Patrick Foley <patrick.foley@intel.com>
---------
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
Co-authored-by: Patrick Foley <patrick.foley@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolved flake8 issues
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* GPU Added for aggregator
Fixed issue in 103 Cyclic Institutional Incremental Learning tutorial
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolve Coverity Issues (#874)
* Fix coverity issues
* Resolve remaining coverity issues
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Migrate to Ubuntu 22.04 LTS release (supported through 2027) (#875)
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated documentation:
docs/workflow_interface.rst
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated documentation
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update workflow_interface.rst
Fixing typo
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added best model and last model extraction technique in docs/workflow_interface.rst
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added GPU for aggregator
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolving merge conflicts in 103 cyclic tutorial notebook
fixing FedAvg in workflow interface tutorials to be compatible with latest numpy stable release (1.24.3) (#833)
* fixing FedAvg averaging in order to be compatible with numpy v1.24+
Signed-off-by: kta-intel <kevin.ta@intel.com>
* uncommenting installations for consistency with other tutorials
Signed-off-by: kta-intel <kevin.ta@intel.com>
* fixing 301_MNIST_Watermarking tutorial FedAvg
Signed-off-by: kta-intel <kevin.ta@intel.com>
* fixing 301_MNIST_Watermarki
ng tutorial FedAvg
Signed-off-by: kta-intel <kevin.ta@intel.com>
* Switching to py38 kernel and clearing cell outputs
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolved merge conflicts in tests/github/experimental/testflow_datastore_cli.py
Testflow for verifying stdout redirection to Metaflow datastore (#758)
* implemented ray.wait
* reverted changes back after testing
* adding datastore cli test case
* removed unused variables
* removed stderr validation
* fixed lint suggestions
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added weighted_average aggregation function under openfl.experimental.interface.{keras,torch}.aggregation_funtions
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update EdenPipeline in the documentation (#877)
Signed-off-by: Amit Portnoy <1131991+amitport@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* WIP: CI Scans (#873)
* Initial scans commit for bandit, hadolint, trivy
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Address bandit scan results
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix Trivy action
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix linting
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add Coverity Badge
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update Hadolint threshold to flag errors only
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update Hadolint threshold to flag errors only
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update ROADMAP.md (#878)
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* initial commit
* add docstrings
* change importlib to import
* remove unnecesary files, replace ray with ray_grouped
* remove max concurency, add number of actors
* Trigger CI
* run tests
* lint changes
* flake
* changed number of actors to num_actors, added docs
* Fixed workflow API tests
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* lint fixes
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Signed-off-by: sarthakpati <sarthak.pati@hotmail.com>
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <Parthx.Mandaliya@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
Signed-off-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Signed-off-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: kta-intel <kevin.ta@intel.com>
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
Signed-off-by: Amit Portnoy <1131991+amitport@users.noreply.github.com>
Co-authored-by: Patrick Foley <patrick.foley@intel.com>
Co-authored-by: Olga Perepelkina <olga.perepelkina@intel.com>
Co-authored-by: Joe Devon <138038+joedevon@users.noreply.github.com>
Co-authored-by: Sarthak Pati <sarthak.pati@hotmail.com>
Co-authored-by: Prashant Shah <40899779+SprashAI@users.noreply.github.com>
Co-authored-by: akantak <aleksander.kantak@intel.com>
Co-authored-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Co-authored-by: Parth Mandaliya <Parthx@Mandaliya.intel.com>
Co-authored-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Co-authored-by: Keerti Talwar <keertix.talwar@intel.com>
Co-authored-by: KeertiX <keertix.talwarx@intel.com>
Co-authored-by: wangleflex <106506636+wangleflex@users.noreply.github.com>
Co-authored-by: He, Dan H <dan.h.he@intel.com>
Co-authored-by: xiaoranf <desolatefang@gmail.com>
Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com>
Co-authored-by: Lei5 Chen <lei5.chen@intel.com>
Co-authored-by: Beverly Klemme <35578090+bjklemme-intel@users.noreply.github.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Co-authored-by: Yi CAO <yi2.cao@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Co-authored-by: Francis Storr <francis.storr@intel.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com>
Co-authored-by: kta-intel <kevin.ta@intel.com>
Co-authored-by: Mansi Sharma <77758170+mansishr@users.noreply.github.com>
Co-authored-by: Mansi Sharma <mansi.sharma@intel.com>
Co-authored-by: Sachin Gupta <sachin.gupta.dsp@gmail.com>
Co-authored-by: Keerti Prakash Talwar <115972088+KeertiX@users.noreply.github.com>
Co-authored-by: Amit Portnoy <1131991+amitport@users.noreply.github.com>
manuelhsantana
pushed a commit
that referenced
this pull request
Jul 10, 2024
* Federated Runtime v1.0
experimental Aggregator and Collaborator in working condition
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added test, and mnist experimental workspaces working prototype
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Working on integration with Ishant's, and Keerti's code
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Second half of integration installment.
Remaning:
Integration of data.yaml file.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removing unnecessary directory my_federation.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* 1. Removed unncessart files.
2. Fix `fx plan freeze` command not working issue.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added function for test workspace
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added include_exclude testcase workspace.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Default execution workspace is mnist.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* data.yaml changes are integrated with this update.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Running a federation with GaNDLF Documentation (#794)
* Initial commit of Running the federation with GaNDLF Documentation
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update docs/running_the_federation_with_gandlf.rst
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update README.md
Removed references to Intel's ownship, given it's now owned by the LF AI and Data.
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix Flake8 C419 for Ubuntu CI (#800)
C419 Unnecessary list comprehension passed to any()/all() prevents short-circuiting - rewrite as a generator
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update README.md
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix warnings and issues in docs (#825)
* Fix warnings and issues in docs
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
* fixup! Fix warnings and issues in docs
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
---------
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add Logo (#827)
* Add Logo
* Update README.md
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Change OpenFL documentation font to improve accessibility (#809)
This replaces the font of OpenFL documents with Intel One Mono font for low vision developers.
Known issues:
1. The text font within the images has not been changed.
2. Some icons that do not exist in the new font cannot be displayed properly.
Fixes securefederatedai#799
Co-authored-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Co-authored-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update unit tests to improve code coverage (#821)
* Update ci config
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add unit test for following files
- openfl/federated/plan/plan.py
- openfl/interface/aggregation_functions/core/adaptive_aggregation.py
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add some test cases for databases module
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Fix bugs for databases module unittest
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Update unit tests for component module
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Restore workflow config and update some comments
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Enable save_ test case.
Add yaml under test dir for unit test usage.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove plan to new dir.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove plan to new dir.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add aggregator start test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 2 aggregator test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 1 aggregator test case.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Format code.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Refactor code.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add collaborator start test cases.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Add 1 collaborator test case.
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Format with flake8
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
* Remove TODO comments
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
---------
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com>
Co-authored-by: Lei5 Chen <lei5.chen@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add PyTorch linear regression example (#808)
This adds a new tutorial example on distributing a linear regression task over OpenFL cluster.
The model is defined by Pytorch which is able to run over both cpu (by default) and gpu. The dataset is generated by make_regression from sklearn.datasets with pre-defined parameters.
Fixes #797
Co-authored-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* This prints out the hash of the CSR to disk for both the aggregator and (#813)
* This prints out the hash of the CSR to disk for both the aggregator and
collaborator. The user then compares and approves this hash with the
hash printed out of the file to validate the CSR. In addition, a warning
message is pritned if certify is run in silent mode.
Fixes securefederatedai#692
Signed-off-by: Grant Baker <grant.baker@intel.com>
* Refactor read_csr function to use get_csr_hash
Signed-off-by: Grant Baker <grant.baker@intel.com>
* Ask to check hashes before prompt
---------
Signed-off-by: Grant Baker <grant.baker@intel.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Improve workspace requirements import (#810)
Remove the dump_requirement_file operation in export_ method.
Fixes securefederatedai#767
Co-authored-by: Li, Qingqing <qingqing.li@intel.com>
Co-authored-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
Signed-off-by: Wang, Le <le3.wang@intel.com>
Signed-off-by: Wu, Caili <caili.wu@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Issue 506 Added Example using FedProx (#818)
* created new ineractive_api dir to hold pytorch fedprox mnist example
corrected files
changed to FedProxOptimizer and ran set_old_weights for new FedProx Pytorch example
renamed FedProx notebook
used mode.parrameters() to get pytorch model weights
got weights using state_dict
changed old wieghts to list (for serialization) and fixed README
input wieghts before zero_grad
[Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api
This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.
Fixes: #506
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api
This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.
Fixes: securefederatedai#506
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* Update README.md
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
* addressed comments by psfoley: corrected words in the jupyter notebook metadata and added a link to the FedProx paper in the README.
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
---------
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* [Bug: 768] FX CLI: Separate create, cert gen commands (#807)
This change separates existing command
"fx collaborator.py generate-cert-request" command into two
commands.
"fx collaborator create -n {NAME} -d {DATA_PATH: optional}".
"fx collaborator generate-cert-request -n {NAME}".
Fixes #768
Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add new tutorial example to OpenFL interactive API (#812)
* Add new tutorial example to OpenFL interactive API
This adds a new tutorial example on distributing a linear regression task over OpenFL cluster
The model is defined by scikit-learn which is able to run over both cpu (by default) and gpu. The dataset is 1-dimensional noisy data of sinusoid with pre-defined parameters.
Fixes #798
Co-authored-by: Beverly Klemme <beverly.klemme@intel.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Signed-off-by: Yi CAO <yi2.cao@intel.com>
* reduced requirements.txt in workspace
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
---------
Signed-off-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Co-authored-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* build(deps): bump tensorflow in /openfl-workspace/tf_cnn_histology (#776)
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* build(deps): bump tensorflow (#777)
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update GaNDLF repo location and test CI with master branch
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update GaNDLF repo location and test CI with master branch
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update GaNDLF repo location and test CI with master branch
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix documentation links. Change path names and templates for CI
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix paths
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix paths
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix breaking tests
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add compatible onnx version to requirements.txt file
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix wrong csv file name
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix wrong csv file name
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix wrong names in workflow file
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix wrong data path
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix lint in test_gandlf.py
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix lint errors
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Signed-off-by: Yi CAO <yi2.cao@intel.com>
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Co-authored-by: Prashant Shah <40899779+SprashAI@users.noreply.github.com>
Co-authored-by: akantak <aleksander.kantak@intel.com>
Co-authored-by: wangleflex <106506636+wangleflex@users.noreply.github.com>
Co-authored-by: He, Dan H <dan.h.he@intel.com>
Co-authored-by: xiaoranf <desolatefang@gmail.com>
Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com>
Co-authored-by: Lei5 Chen <lei5.chen@intel.com>
Co-authored-by: Beverly Klemme <35578090+bjklemme-intel@users.noreply.github.com>
Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Co-authored-by: Yi CAO <yi2.cao@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid (#841)
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fix GaNDLF documentation links (#842)
* Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix links in GaNDLF Documentation
* Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix links in GaNDLF Documentation
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fix incorrectly formatted link in docs (#839)
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added licensing information to all experimental workspaces
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Made changes to LocalRuntime, and tested
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Rename collaborator_name variable to name in
experimental/component/collaborator/collaborator.py file.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump onnx in /openfl-workspace/gandlf_seg_test (#840)
Bumps [onnx](https://github.com/onnx/onnx) from 1.12 to 1.13.0.
- [Release notes](https://github.com/onnx/onnx/releases)
- [Changelog](https://github.com/onnx/onnx/blob/main/docs/Changelog.md)
- [Commits](https://github.com/onnx/onnx/compare/v1.12.0...v1.13.0)
---
updated-dependencies:
- dependency-name: onnx
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Selected collaborators functionality added, test workspace of the same
is work-progress.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Selected collaborator testcases included with this commit.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Testcase private attributes workspace added with this commit.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Instead of remove private attributes from checkpoint, changed the value
to string "Private attributes: Not Available."
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added / Modified types of funciton arguments, and their return types.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Aggregator shutdown related changes are done in this commit
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update testflow_subset_of_collaborators.py
Updated subset of collaborators testcase
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified subset of collaborators testcase.
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Add files via upload
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Accessibility updates (#861)
* Fix incorrectly formatted link in docs
Signed-off-by: Francis Storr <francis.storr@intel.com>
* Font styling, color contrast, other accessibility updates
This update:
1. Restores Roboto and Lato fonts for most body copy, leaving Intel One Mono for code samples.
2. Adds colors (in `colors.css`)
3. Adds a new `accessibility_overrides.css` file containing CSS that improves the accessibility of the documentation and, where possible, Read The Docs. These updates remediate numerous non-conforming WCAG 2.x Level AA bugs. The use of a separate file for this hopefully makes these changes easier to manage and less likely to be accessibility overwritten in the future.
Closes #848
Signed-off-by: Francis Storr <francis.storr@intel.com>
---------
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_nlp (#773)
* build(deps): bump tensorflow in /openfl-workspace/keras_nlp
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update RMSProp optimizer import
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* flake8
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_cnn_mnist (#771)
* build(deps): bump tensorflow in /openfl-workspace/keras_cnn_mnist
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* revert experimental Adam to legacy (#863)
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: kta-intel <kevin.ta@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_cnn_with_compression (#770)
* build(deps): bump tensorflow
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update Adam Optimizer import
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.9.3 to 2.11.1 in /openfl-tutorials/interactive_api/Flax_CNN_CIFAR (#775)
* build(deps): bump tensorflow
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* Fixed breaking backages
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add quiet flag back to pip install
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow-cpu from 2.8.4 to 2.11.1 in /openfl-workspace/keras_nlp_gramine_ready (#769)
* build(deps): bump tensorflow-cpu
Bumps [tensorflow-cpu](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow-cpu
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* Use legacy RMSprop optimizer
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Accessibility color contrast fixes (#864)
* Fix incorrectly formatted link in docs
Signed-off-by: Francis Storr <francis.storr@intel.com>
* Font styling, color contrast, other accessibility updates
This update:
1. Restores Roboto and Lato fonts for most body copy, leaving Intel One Mono for code samples.
2. Adds colors (in `colors.css`)
3. Adds a new `accessibility_overrides.css` file containing CSS that improves the accessibility of the documentation and, where possible, Read The Docs. These updates remediate numerous non-conforming WCAG 2.x Level AA bugs. The use of a separate file for this hopefully makes these changes easier to manage and less likely to be accessibility overwritten in the future.
Closes #848
Signed-off-by: Francis Storr <francis.storr@intel.com>
* Color contrast updates for accessibility
Color contrast updates for accessibility
- update generic `a` element
- update color of links in the toggle-able read-the-docs panel
- update the color of the text in search results
- update the color of notes headers
Signed-off-by: Francis Storr <francis.storr@intel.com>
---------
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Testflow for verifying stdout redirection to Metaflow datastore (#758)
* implemented ray.wait
* reverted changes back after testing
* adding datastore cli test case
* removed unused variables
* removed stderr validation
* fixed lint suggestions
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Tweak link color so it’s not so aggressive (#865)
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* External Loop Functionality Added
External Loop Functionality Added
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* External Loop Functionality Added
External Loop Functionality Added
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* External Loop Functionality Added
External Loop Functionality Added
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added following tutorials, and testcase:
1. Vertical FL
2. Vertical FL Two Party
3. Internal Loop
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* plan.yaml modified in 301 watermarking, and subset of collaborators.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modifying temp.sh for 2 collaborators.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update aggregator.py
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* FQDN switched to localhost
FQDN switched to localhost
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* While activating experimental OpenFL commands, install depedencies as well.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Install experimental requirements while activating experimental openfl commands.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update experimental-requirements.txt
Added ray 2.2.0 to experimental-requirements.txt file
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update requirements_workflow_interface.txt
Metaflow, and Ray dependencies are moved to openfl-workspace/experimental/experimental-requrirements.txt file.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Delete openfl/experimental/utilities/utils.py, and removed torch depency from openfl/experimental/utilities/resources.py
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update requirements_workflow_interface.txt
Updated experimental tutorials requirements.txt file
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updating 201 GPUs tutorial
Updated Workflow_Interface_201_Exclusive_GPUs_with_Ray.ipynb for Aggregator, and Collaborator as stateful actor
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified 101, 102, 103, 301, 401 tutorials as per Aggregator, & Collaborator stateful collaborators
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Excluding 'experimental' directory from workspace templates
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update 101 tutorial data.yaml
Updated 101 tutorials data.yaml to correct a mistake by in index parameter of private attribute function.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update resources.py
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified get_number_of_gpus function
Modify get_number_of_gpus function
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* This commit brings following changes:
1. Removed torch dependency from "get_number_of_gpus"
2. Added keras mnist example notebook
3. Added keras mnist workspace example
4. Removed openfl-workspace/experimental/experimental-requirements.txt
5. "fx aggregator start" command will install libraries from experimental tutorials requirements_workflow_interface.txt file
6. Added testcase_datastore_cli, testcase_reference and testcase_reference_with_include_exclude
7. Updated 101 torch mnist plan.yaml and data.yaml
8. Removed aggregator start flow thread from cli/aggregator.py
9. At last changes made in federated runtime
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /tests/github/interactive_api_director/experiments/tensorflow_mnist/envoy (#772)
* build(deps): bump tensorflow
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* Update sd_requirements.txt
* revert to legacy SGD and install tensorflow==2.11 for workflow
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: kta-intel <kevin.ta@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <patrick.foley@intel.com>
Co-authored-by: kta-intel <kevin.ta@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/tf_2dunet (#774)
* build(deps): bump tensorflow in /openfl-workspace/tf_2dunet
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1)
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* Update requirements.txt
to retrigger CI
* Update requirements.txt
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* This commit brings following changes:
1. Renamed Workflow_Interface_101_Keras_MNIST_with_GPU.ipynb to Workflow_Interface_104_Keras_MNIST_with_GPU.ipynb
2. Updated documentation in Workflow_Interface_104_Keras_MNIST_with_GPU.ipynb
3. protobuf bumped from 3.19.6 to 3.20.0 in setup.py
4. Incorporating review comments (WIP)
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified 104 Keras MNIST tutorial
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* This comming brings following changes:
1. Experimental Aggregator workflow testcases moved to test/github/experimental/workspace directory
2. Added dependecy related changes
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removing unnecessary logs
Removing unnecessary logs
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update collaborator.py
Removing unnecessary logs
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Avoided deep copying the context by removing private attributes from context before checkpoint
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Incoporated review comments
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added dependecies to each tutorial notebooks
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* pinned tensorboardX (#870)
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* While taking aggregator step remove private attributes before taking checkpoint and set it back to ctx after checkpoint
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removing unnecessary deepcopies from aggregator.py file
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removing unnecessary comments
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update stream_redirect.py
Removing unnecessary imports
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added color escape sequences to datastore cli localruntime and workspace testcases
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update requirements_privacy_meter.txt
torch 1.13.1 requires torchvision 0.14.1 not 0.14.0
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update Workflow_Interface_VFL_Two_Party
Added actor related changed to Workflow_Interface_VFL_Two_Party
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Files added required to test experimental aggregator based workflow by GitHUB actions
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update Workflow_Interface_104_Keras_MNIST_with_GPU.ipynb
Removing GPU parameter from collaborator decorator.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update resources.py
Updated get_number_of_gpus function
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updating import statement
In 104 keras workspace utils.py updating import SummaryWriter statement from torch to tensorflow
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* With this commit path of template can be explicitely given, user does not have to
choose from available example templates. Only applicable to experimental openfl.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fixed flake8 issues and typos
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolved flake8 issues,
Added warning statements when data.yaml is not found or aggregator / collaborator private attributes are not found in data.yaml,
Tested by running all tutorials and tests
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Moving the logs after data.yaml warning, and removing unnecessary blank lines.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Adding N-level arguments functionality
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update workflow_interface.rst
Added section on how to save best and last model from Metaflow CLI
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolving last few TODO items.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Updated logs to provide exact information to user.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* This commit brings following updates:
1. Remove unnecessary spaces from Workflow_Interface_102_Aggregator_Validation.ipynb
2. Upgraded protobuf to 3.20.3 in setup.py as per tensorboard requirements
3. Modified 101-torch-cnn-mnist workspace for n-level arguments
4. Added a federated runtime workspace for 102-aggregator-validation
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* This commit brings following changes:
1. Added 501_pytorch_tinyimagenet_transfer_learning workspace for experimental workflow interface
2. Removed `feature_shape` from openfl/experimental/interface/cli/plan.py
3. Resolved flake8 errors in openfl-workspace/experimental directory
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update data.yaml
Correcting a mistake train dataset assigned to test and vice versa.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update flow.py
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update flow.py
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Adding functionality to convert jupyter notebook to workspace (in progress)
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Write flow.py, collaborator_private_attrs.py and aggregator_private_attrs.py automatically
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Find aggregator, and collaborator arguments
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modifying arguments help
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removed automatically generated Zone.Identifier file
Added Approach2 notebook
Modified creator.py
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* workspace_creator renamed to workspace_builder
finding values without help of any tags
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Finished exporting data.yaml, plan.yaml.
Workspace creator validated for 101 MNIST and 301 Watermarking with MNIST
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removing round number constant argument from 301 MNIST WATERMARKING
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* * Created get_collaborator_kwargs function in localruntime class which takes collaborator name as argument and returns name of private attributes function and arguments required to call it.
* Changed workspace builder code used get_collaborator_kwargs function to build data.yaml file.
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified get_collaborator_args function
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified workspace_builder/build.py file to resolve a typo
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Removed unnecessary files from template_workspace directory
Moved print_tree to after generating python script
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added documentation and inline comments for workspace_builder
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added libraries required by WorkspaceBuilder
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update Tensorflow, gRPC, Protobuf dependencies (#868)
* Update Tensorflow to latest, finally update grpcio/protobuf
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Lint issue fix and missing tf reference
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* pyzmq version fixed
* fix taskrunner tests for windows
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* fix taskrunner test syntax for windows
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* adding user option to workspace pip install requirements for windows
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* fix windows CI test
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* testing virtual env for windows github actions
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* testing virtual env for windows github actions
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* testing virtual env for windows github actions
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* testing venv for windows
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* test venv for windows
* test venv for windows
* Added new KerasSerializer. Fixed other Interactive API experiments
* Update taskrunner.yml
* Update taskrunner.yml
* Update workspace.py
* Update workspace.py
* Update taskrunner.yml
* Remove get_model import from global namespace so dependencies are not loaded into memory unnecessarily (breaking windows build)
* Refactoring and cleaning up imports to support Windows install
* Fixed logger import paths
* Fix missing imports
* Fix native import
* Fix lint errors
* Fix keras optimizer patch. Remove irrelevant unit test
* Format logs in UTF-8 for windows
* Update interactive-kvasir.yml
* Consolidate github actions python versions to single file
* Update python versions
* Update python versions
* Update python versions
* Reduce # of DataLoader workers for Pytorch Kvasir CI test
* Fix Windows encoding
* Fix Windows encoding and limit rounds so Github Actions CI doesn't run out of memory
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix windows encoding
* Fix Windows encoding
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
Co-authored-by: Mansi Sharma <77758170+mansishr@users.noreply.github.com>
Co-authored-by: Mansi Sharma <mansi.sharma@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Add FL plan description to documentation (#872)
* Add plan description to documentation
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* fix indentation
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* Apply suggestions from code review
Co-authored-by: Patrick Foley <patrick.foley@intel.com>
---------
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
Co-authored-by: Patrick Foley <patrick.foley@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolve Coverity Issues (#874)
* Fix coverity issues
* Resolve remaining coverity issues
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Migrate to Ubuntu 22.04 LTS release (supported through 2027) (#875)
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fixed flake8 issues
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fixed flake8 issues in test/experimental directory
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Accessibility updates (#861)
* Fix incorrectly formatted link in docs
Signed-off-by: Francis Storr <francis.storr@intel.com>
* Font styling, color contrast, other accessibility updates
This update:
1. Restores Roboto and Lato fonts for most body copy, leaving Intel One Mono for code samples.
2. Adds colors (in `colors.css`)
3. Adds a new `accessibility_overrides.css` file containing CSS that improves the accessibility of the documentation and, where possible, Read The Docs. These updates remediate numerous non-conforming WCAG 2.x Level AA bugs. The use of a separate file for this hopefully makes these changes easier to manage and less likely to be accessibility overwritten in the future.
Closes #848
Signed-off-by: Francis Storr <francis.storr@intel.com>
---------
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* fixing FedAvg in workflow interface tutorials to be compatible with latest numpy stable release (1.24.3) (#833)
* fixing FedAvg averaging in order to be compatible with numpy v1.24+
Signed-off-by: kta-intel <kevin.ta@intel.com>
* uncommenting installations for consistency with other tutorials
Signed-off-by: kta-intel <kevin.ta@intel.com>
* fixing 301_MNIST_Watermarking tutorial FedAvg
Signed-off-by: kta-intel <kevin.ta@intel.com>
* fixing 301_MNIST_Watermarki
ng tutorial FedAvg
Signed-off-by: kta-intel <kevin.ta@intel.com>
* Switching to py38 kernel and clearing cell outputs
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: kta-intel <kevin.ta@intel.com>
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Testflow for verifying stdout redirection to Metaflow datastore (#758)
* implemented ray.wait
* reverted changes back after testing
* adding datastore cli test case
* removed unused variables
* removed stderr validation
* fixed lint suggestions
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolving DCO issue
fixing FedAvg in workflow interface tutorials to be compatible with latest numpy stable release (1.24.3) (#833)
* fixing FedAvg averaging in order to be compatible with numpy v1.24+
Signed-off-by: kta-intel <kevin.ta@intel.com>
* uncommenting installations for consistency with other tutorials
Signed-off-by: kta-intel <kevin.ta@intel.com>
* fixing 301_MNIST_Watermarking tutorial FedAvg
Signed-off-by: kta-intel <kevin.ta@intel.com>
* fixing 301_MNIST_Watermarki
ng tutorial FedAvg
Signed-off-by: kta-intel <kevin.ta@intel.com>
* Switching to py38 kernel and clearing cell outputs
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: kta-intel <kevin.ta@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update EdenPipeline in the documentation (#877)
Signed-off-by: Amit Portnoy <1131991+amitport@users.noreply.github.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fixed flake8 issues
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Added weighted_average aggregation function under openfl.experimental.interface.{keras,torch}.aggregation_funtions
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Tested all local-runtime & federated-runtime tutorials and testcases
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Resolving merge conflicts in experimental local-runtme tutorials 101, 103, 201, & 301
fixing FedAvg in workflow interface tutorials to be compatible with latest numpy stable release (1.24.3) (#833)
* fixing FedAvg averaging in order to be compatible with numpy v1.24+
Signed-off-by: kta-intel <kevin.ta@intel.com>
* uncommenting installations for consistency with other tutorials
Signed-off-by: kta-intel <kevin.ta@intel.com>
* fixing 301_MNIST_Watermarking tutorial FedAvg
Signed-off-by: kta-intel <kevin.ta@intel.com>
* fixing 301_MNIST_Watermarki
ng tutorial FedAvg
Signed-off-by: kta-intel <kevin.ta@intel.com>
* Switching to py38 kernel and clearing cell outputs
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: kta-intel <kevin.ta@intel.com>
---------
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* WIP: CI Scans (#873)
* Initial scans commit for bandit, hadolint, trivy
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Address bandit scan results
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix Trivy action
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix linting
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Add Coverity Badge
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update Hadolint threshold to flag errors only
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Update Hadolint threshold to flag errors only
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Update ROADMAP.md (#878)
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* This commit brings following changes:
1. Renaming workspace_builder module to workspace_export.
2. WorkspaceBuilder class renamed to WorkspaceExport.
3. Added WorkspaceExport.export function for user which wraps generate_requirements, generate_plan_yaml, generate_data_yaml functions.
4. Merged WorkspaceExport module to `fx workspace create` command by adding new following arguments:
- `--notebook` Path to jupyter notebook
- `--template_workspace_dir` Output path for generated workspace
5. WorkspaceExport removed from 101, and 103 tutorials.
6. setup.py changed accordingly.
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* This commit brings following changes:
1. output_dir renamed to output_workspace also the user must pass this parameter
(default=/tmp is now removed) or there will be an error.
2. template_workspace_path is not required anymore.
3. Added a new tutorials Workflow_Interface_1001_Workspace_Creation_from_JupyterNotebook.ipynb
(copy of Workflow_Interface_301_MNIST_Watermarking.ipynb) explaining how to use WorkspaceExport.
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* In Workflow_Interface_1001 tutorial list of collaborator are changed to 5 from 2
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Uncommeted pip install libraries
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Adding GPU for aggregator in 201, Global DP & Privacy Meter tutorials
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modifed documentation in 1001 tutorial
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Modified documentation in 1001 tutorial
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* Fixing 'param' attribute not found issue. in 301, 1001 experimental tutrials and 301
mnist watermarking workspace.
Sol.
imagen library installs param depedency latest version
and param package got an upgrde recently. Pinned param to 1.13.0
after installing imagen which fixed the issue.
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
* VFL 2 party example
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* participant names to lowercase and changes to instructions
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
* Resolving missing packages from watermarking examples that break python 3.9+. Fix linting, spelling. Remove experimental aggregation functions
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Remove duplicate files in openfl.experimental
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Trigger CI
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Moving test to be conditional
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix inconsistent use of enumerate in loops
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fixing tests
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Accomodate conversion of names to lower case
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Missing torchvision dependency in tests
Signed-off-by: Patrick Foley <psfoley@gmail.com>
* Fix lint issues
Signed-off-by: Patrick Foley <psfoley@gmail.com>
---------
Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com>
Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Signed-off-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: Francis Storr <francis.storr@intel.com>
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: kta-intel <kevin.ta@intel.com>
Signed-off-by: Mansi Sharma <mansi.sharma@intel.com>
Signed-off-by: Amit Portnoy <1131991+amitport@users.noreply.github.com>
Co-authored-by: Patrick Foley <patrick.foley@intel.com>
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Co-authored-by: Prashant Shah <40899779+SprashAI@users.noreply.github.com>
Co-authored-by: akantak <aleksander.kantak@intel.com>
Co-authored-by: wangleflex <106506636+wangleflex@users.noreply.github.com>
Co-authored-by: He, Dan H <dan.h.he@intel.com>
Co-authored-by: xiaoranf <desolatefang@gmail.com>
Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com>
Co-authored-by: Lei5 Chen <lei5.chen@intel.com>
Co-authored-by: Beverly Klemme <35578090+bjklemme-intel@users.noreply.github.com>
Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Co-authored-by: Yi CAO <yi2.cao@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Francis Storr <francis.storr@intel.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com>
Co-authored-by: Keerti Prakash Talwar <115972088+KeertiX@users.noreply.github.com>
Co-authored-by: kta-intel <kevin.ta@intel.com>
Co-authored-by: porteratzo <44075849+porteratzo@users.noreply.github.com>
Co-authored-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>
Co-authored-by: Mansi Sharma <77758170+mansishr@users.noreply.github.com>
Co-authored-by: Mansi Sharma <mansi.sharma@intel.com>
Co-authored-by: Amit Portnoy <1131991+amitport@users.noreply.github.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
When upgrading to TF 2.11.1,
ke.optimizers.Adam()refers tokeras.optimizers.optimizers_experimental, which breaks the task runner because the weights are being stored differently.ke.optimizers.legacy.Adam()behaves consistently with the TF 2.8.4Resolution for: #771