Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
do allgather only in shared optimizer states groups (#4167)
* skip all-gather * add notes --------- Co-authored-by: Logan Adams <114770087+loadams@users.noreply.github.com> Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>
- Loading branch information