Skip to content

Distributed optimizer reduces GPT embedding grads in FP32#8792

Merged
erhoo82 merged 6 commits intoNVIDIA:mainfrom timmoon10:fp32-embedding-gradsApr 5, 2024

Commits

Commits on Apr 2, 2024

Commits on Apr 3, 2024

Commits on Apr 4, 2024