Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Fix all gather while writing to a file during T5 finetuning (#5561)
* Gather from data parallel only instead of all ranks Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca>
- Loading branch information