Multiple machines #55
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
joyce-yuan
pushed a commit
that referenced
this pull request
Aug 24, 2024
* define config data type * improve grpc execution * fix missing attribute bug * add capability to run across multiple machines * update docs * update the docs
tremblerz
added a commit
that referenced
this pull request
Aug 26, 2024
* configs work for fed weight non iid * fixed some inconsistent names * added fed weight and fed data repr algos * added sys config for non iid and support distr * fixed names to allow non iid data * cleaned * modified data utils to work with system * added defkt * update docs (#29) * update gitignore (#30) * fix mkdocs * Add tasks page * Update mkdocs yml * restructuring docs * add l2c description * add collabench paper * revamp docs * Rename Logging.md to logging.md * Object Detection Support (#28) * data loader for pascal dataset * model for yolo * added albumentations * ignoring pascal images * fixed data loaders * added path for pascal dataset * support for training for pascal dset * settings for object detection and yolo model * small fix * adding yolo model to model utils * exporting the model function * export model * changed num samples per user * changed NUM_CLS to num_cls * algos updated setting * configs for yolo and pascal * enabled support for pretrained yolo: * support for testing for pascal * modularize test and train * modularized * configs for yolo * separated the configs for object detect --------- Co-authored-by: jyuan24 <jyan24@mit.edu> * New grpc (#34) * reduce logging * revamp communication interface; mpi version works in this commit * enable strict type checking * first version of grpc working * automate configuration * first version working end to end for fl.py * add instructions for later * reduce memory footprint and improve type checking * keep a small model as default * Object detection docs (#36) * object detection docs * small fix * revamp docs * minor fix * include datasets page (#39) * add text classification information * datasets update * three tables matching three figures in paper * fixed format * test * test * test * fixed table 3 * write up fixes * Update README.md * Update README.md * image classification writeup (#43) * set up development tab * restructure * remove view and edit page access * three tables matching three figures in paper (#47) * tables, config page * add feature table (#49) * config * getting started dir struct * add customize.md * feature comparison table (#53) * Multiple machines (#55) * define config data type * improve grpc execution * fix missing attribute bug * add capability to run across multiple machines * update docs * update the docs * configs work for fed weight non iid * added fed weight and fed data repr algos * added sys config for non iid and support distr * added defkt * updated config to current code * algo update * minor fix * modified algos but comms isn't working * support for tags, and list of ids * defkt runs * fed isolated algo * modified fed central to work with comm utils * fed iso and fed central * modified l2c to fit comms protocol * add train dset attribute * fed central finally working * changed clients to users for all files * config file updates for l2c and fed central * changed clients to users * swarm algo updated to current comm utils protocol * fl weight updated to new comm utils * fed weight and swarm works :) * fl static upgraded to new comms * fl static works now :) * took out some unsupported algos * fix key errors for num_users < 4 * algo config updated * static.py run --------- Co-authored-by: jyuan24 <jyan24@mit.edu> Co-authored-by: Gautam Jajoo <gautamjajoo1729@gmail.com> Co-authored-by: ishaan <66063951+ishaansingh22@users.noreply.github.com> Co-authored-by: Abhishek Singh <abhishek.s14@iiits.in>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.